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EXECUTIVE  SUMMARY 

Fatigue  from  sleep  loss  and  circadian  misalignment  jeopardizes  cognitive  performance  and 
safety  of  individuals  during  sustained  Air  Force  operations  and  in  other  around-the-clock 
operational  environments.  Mathematical  models  of fatigue  and  performance  provide  a  useful 
methodology  for  the  prediction  of  cognitive  impairment  resulting  from  sleep  loss  and  circadian 
disruption.  However,  currently  available  models  do  not  have  the  capability  to  make  predictions 
for  individuals,  which  makes  them  unreliable  at  the  level  of  persons  or  small  teams.  Also, 
currently  available  models  do  not  accurately  predict  the  effects  on  performance  of  chronic  sleep 
restriction,  which  reduces  their  usefulness  in  sustained  operations.  To  deal  with  these  problems, 
we  implemented  and  extended  a  cutting-edge  statistical  technique  called  Bayesian  forecasting  to 
predict  performance  responses  to  sleep  loss  and  circadian  displacement  for  individuals. 
Furthermore,  we  developed  a  new  model  for  the  sleep/wake  homeostatic  regulation  of fatigue  to 
improve  predictions  of performance  deficits  under  conditions  of  chronic  sleep  loss.  As  such,  this 
project  resulted  in  significant  advances  in  fatigue  and  performance  modeling,  addressing  the  Air 
Force ’s  need  to  understand  and  help  mitigate  the  effects  of  fatigue  on  cognitive  capability. 

Current  mathematical  models  of  fatigue  and  performance  do  not  accurately  predict  cognitive 
performance  for  individuals  with  a-priori  unknown  degrees  of  trait  vulnerability  to  sleep  loss;  do 
not  predict  performance  reliably  when  initial  conditions  are  uncertain;  and  do  not  yield 
statistically  valid  estimates  of  prediction  accuracy.  These  limitations  diminish  their  usefulness 
for  predicting  the  performance  of  individuals  during  Air  Force  missions  and  in  other  operational 
environments.  To  overcome  these  limitations,  we  developed  a  new  modeling  approach  based  on 
the  extension  of  a  statistical  technique  called  Bayesian  forecasting.  The  extended  Bayesian 
forecasting  procedure  was  implemented  in  the  two-process  model  of  sleep  regulation,  which  has 
been  used  to  predict  performance  on  the  basis  of  a  sleep  homeostatic  process  and  a  circadian 
process. 

Employing  the  two-process  model  with  the  Bayesian  forecasting  procedure  to  predict 
performance  for  individual  subjects  in  the  face  of  unknown  traits  and  uncertain  states  entailed 
subject-specific  optimization  of  three  trait  parameters  (homeostatic  build-up  rate,  circadian 
amplitude  and  basal  performance  level)  and  two  initial  state  parameters  (initial  homeostatic  state 
and  circadian  phase  angle).  Prior  information  about  the  distribution  of  the  trait  parameters  in  the 
population  at  large  was  extracted  from  psychomotor  vigilance  test  (PVT)  performance 
measurements  in  ten  subjects  who  had  participated  earlier  in  a  laboratory  experiment  with  88h  of 
total  sleep  deprivation.  The  PVT  performance  data  of  three  additional  subjects  in  this  experiment 
were  set  aside  beforehand  for  use  in  prospective  computer  simulations. 

The  simulations  involved  updating  the  subject-specific  model  parameters  every  time  the  next 
performance  measurement  became  available,  and  then  predicting  performance  24h  ahead. 
Comparison  of  the  predictions  to  the  subjects’  actual  data  revealed  that  as  more  data  became 
available  for  the  individuals  at  hand,  the  performance  predictions  became  increasingly  more 
accurate  and  had  progressively  smaller  95%  confidence  intervals,  as  the  model  parameters 
converged  efficiently  to  those  that  best  characterized  each  individual.  Even  when  more 
challenging  simulations  were  run  (mimicking  a  change  in  the  initial  homeostatic  state;  simulating 
the  data  to  be  sparse),  the  predictions  were  still  considerably  more  accurate  than  would  have 
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been  aehieved  by  the  two-proeess  model  alone.  Although  the  work  described  in  this  report  is 
limited  to  periods  of  consolidated  wakefulness  with  stable  circadian  rhythms,  and  follow-up 
translational  efforts  are  needed,  the  results  obtained  demonstrate  that  the  Bayesian  forecasting 
procedure  can  successfully  overcome  some  of  the  major  outstanding  challenges  for  mathematical 
prediction  of  cognitive  performance  in  operational  settings. 

As  a  foundation  for  the  development  of  the  Bayesian  forecasting  procedure,  we  used  the  two- 
process  model  of  sleep  regulation.  However,  in  and  of  itself,  the  two-process  model  does  not 
accurately  predict  the  effects  on  performance  of  chronic  sleep  restriction.  This  diminishes  the 
usefulness  of  the  model  during  sustained  Air  Force  operations  and  in  many  other  operational 
scenarios.  To  overcome  this  limitation,  we  developed  a  new  sleep/wake  homeostatic  model  of 
fatigue  and  performance.  We  showed  that  the  two-process  model  belongs  to  a  broader,  new  class 
of  models  formulated  in  terms  of  coupled  non-homogeneous  first-order  ordinary  differential 
equations,  which  have  a  dynamic  repertoire  capturing  waking  cognitive  functions  across  a  much 
wider  range  of  wake/sleep  schedules. 

We  selected  a  specific  case  of  the  new  model  class,  and  demonstrated  the  existence  of  a 
bifurcation:  for  daily  amounts  of  wakefulness  less  than  a  critical  threshold,  cognitive 
performance  (as  represented  by  PVT  measurements)  is  predicted  to  converge  to  an 
asymptotically  stable  fixed  point  (equilibrium);  whereas  for  daily  wakefulness  greater  than  the 
critical  threshold,  cognitive  performance  is  predicted  to  diverge  from  an  unstable  fixed  point. 
Comparison  of  model  simulations  to  laboratory  observations  of  lapses  of  attention  on  the  PVT, 
in  experiments  on  the  effects  of  chronic  sleep  restriction  and  acute  total  sleep  deprivation, 
indicated  that  this  bifurcation  is  an  essential  feature  of  performance  impairment  due  to  sleep  loss. 

We  also  considered  two  new  predictions,  that  may  be  experimentally  verified  to  validate  the 
model.  These  predictions,  if  confirmed,  challenge  conventional  notions  about  the  effects  of  sleep 
and  sleep  loss  on  cognitive  performance.  The  new  model  class  implicates  a  biological  system 
analogous  to  two  connected  compartments  containing  interacting  compounds  with  time-varying 
concentrations  as  being  a  key  mechanism  for  the  regulation  of  cognitive  performance  as  a 
function  of  sleep  loss.  The  dynamics  of  the  new  model  suggests  that  the  adenosinergic 
neuromodulator/receptor  system  may  provide  the  underlying  neurobiology. 

This  final  report  covers  the  work  performed  from  1  Jan  2005  through  30  Sep  2005  at  the 
University  of  Pennsylvania  (AFOSR  grant  FA9550-05- 1-0086),  and  the  subsequent  work 
performed  from  1  Oct  2005  through  29  Feb  2008  at  Washington  State  University  (AFOSR  grant 
FA9550-06- 1-0055)  where  the  project  was  transferred  when  the  PI  (Van  Dongen)  moved  there. 
The  products  of  this  project  include  the  first  method  for  on-line  individualization  of 
mathematical  model  prediction  of  fatigue  and  performance;  and  a  substantially  improved 
mathematical  model  of  fatigue  and  performance  under  conditions  of  chronic  sleep  restriction. 

The  results  of  the  project  represent  significant  advances  in  fatigue  and  performance  modeling. 
They  contribute  to  accurate,  subject-specific  prediction  of  cognitive  impairment  in  Air  Force 
operations,  and  provide  useful  approaches  to  help  optimize  mission  safety  and  success.  The 
results  of  this  project  are  also  highly  relevant  for  the  many  operational  settings  in  today’s  24/7 
society  that  put  individuals  at  risk  of  performance  deficits  due  to  sleep  loss  and  circadian 
displacement. 
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PREDICTING  FATIGUE  AND  PERFORMANCE  IN  INDIVIDUALS:  ACCOUNTING 
FOR  UNKNOWN  TRAITS  AND  UNCERTAIN  STATES 

Introduction 

Increased  fatigue  and  degraded  eognitive  performance  due  to  sleep  loss  and  night  work  are  a 
eoneern  in  Air  Force  operations  and  many  other  operational  settings  (e.g.,  transportation,  health 
eare,  emergency  response,  space  flight).  Mathematical  models  of  fatigue  and  performance  may 
be  useful  to  help  prediet  performance  impairment  resulting  from  sleep  loss  (Neri,  2004).  As 
such,  mathematical  models  may  be  seen  as  fatigue  management  tools,  supporting  the  anticipation 
and  prevention  of  high-risk  situations,  the  implementation  of  safe  and  produetive  work 
sehedules,  and/or  the  timely  delivery  of  fatigue  eountermeasures. 

In  the  AFOSR-sponsored  “Fatigue  and  Performance  Modeling  Workshop”  (June  2002;  Seattle, 
Washington),  a  number  of  mathematical  models  were  discussed  and  evaluated  (Mallis  et  ah, 
2004;  Van  Dongen,  2004).  In  the  proeeedings  of  that  workshop,  scientists  and  stakeholders  alike 
pointed  out  that  to  be  useful  and  reliable  in  operational  settings,  performance  models  must  be 
able  to  deal  with  inter-individual  differenees  in  performance  impairment  from  sleep  loss  (Dinges, 
2004;  Friedl  et  ah,  2004;  Van  Dongen,  2004).  Laboratory  experiments  have  revealed  that  these 
inter- individual  differences  are  substantial,  and  that  they  represent  trait  vulnerability  (Van 
Dongen  et  ah,  2004a).  Thus,  inter-individual  differences  are  important  determinants  of  sleep- 
deprived  performanee  (Van  Dongen  et  ah,  2005b),  and  should  be  eaptured  by  models  deployed 
in  operational  settings  (Dinges  and  Aehermann,  1999). 

Performance  models  can  be  made  to  aecount  for  inter-individual  differenees  by  first  assessing 
every  subject’s  individual  response  to  sleep  deprivation,  and  then  adjusting  the  model  parameters 
to  match  each  subject’s  specific  response.  In  most  operational  environments,  however,  assessing 
everyone’s  response  to  sleep  deprivation  is  unpractical  or  unfeasible.  It  is  a  problem,  therefore, 
that  none  of  the  eurrently  available  mathematical  models  of  performance  can  handle  inter¬ 
individual  differences  unless  the  individuals  are  charaeterized  in  advanee. 

One  proeedure  to  overcome  this  limitation  was  reeently  demonstrated  by  Olofsen  et  al.  (2004); 
Bayes  posterior  distribution  estimation,  also  known  as  Bayesian  foreeasting.  This  approach  is 
grounded  in  Bayesian  statistics,  and  as  such  it  makes  use  of  the  advance  charaeterization  of  the 
inter-individual  variability  in  the  population  as  well,  for  instance  by  studying  performance 
changes  over  time  during  a  sleep  deprivation  experiment.  However,  this  can  be  done  in  a 
representative  sample  drawn  from  that  population — it  is  not  neeessary  to  inelude  the  specifie 
individuals  for  whom  the  mathematieal  model  will  ultimately  be  used.  Modern  statistieal 
techniques  referred  to  as  mixed-effects  modeling  (Vonesh  et  al.,  1997)  allow  the  data  from  the 
studied  sample  to  be  separated  into  consistent  changes  over  time,  systematie  between-subjeets 
varianee  (i.e.,  trait-like  variability),  and  residual  within-subjects  variance  or  error  varianee 
(Olofsen  et  ah,  1999;  Van  Dongen  et  ah,  2004b).  This  yields  information  about  the  prior 
probability  that  any  given  level  of  impairment  would  be  observed  at  a  specific  time  point  in  a 
person  randomly  drawn  from  the  population  at  large.  Importantly,  it  also  produees  probability 
estimates  of  the  contributions  to  that  impairment  level  from  the  person’s  trait  charaeteristics  on 
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the  one  hand,  and  from  error  varianee  (e.g.,  random  short-term  variations  in  alertness)  on  the 
other  hand. 

To  illustrate  this  with  an  example,  eonsider  a  population  of  Air  Foree  pilots,  whose  responses  to 
sleep  loss  eould  be  charaeterized  by  subjeeting  a  representative  sample  of  them  to  sleep 
deprivation  in  a  laboratory.  By  repeatedly  measuring  eaeh  subjeet’s  performanee  during  the 
laboratory  sleep  deprivation  period,  and  subsequently  analyzing  the  eolleetive  measurement  data 
with  mixed-effeets  modeling,  the  pattern  of  consistent  changes  over  time,  the  between-subjects 
variance  and  the  within-subjects  variance  for  performance  impairment  due  to  sleep  loss  could  be 
assessed  for  this  population.  For  the  sake  of  argument,  let’s  assume  that  the  primary  performance 
assay  in  the  sleep  deprivation  experiment  was  a  choice  reaction  time  task.  Let’s  say  that  the 
group-average  response  to  sleep  loss  as  measured  at  midnight,  expressed  relative  to  baseline,  was 
an  increase  of  6  in  the  number  of  response  errors.  Because  of  trait  inter-individual  differences  as 
well  as  random  fluctuations,  there  may  be  some  individual  in  the  population  whose  response  to 
sleep  loss  at  midnight  would  show  an  increase  of  1 1  errors  relative  to  baseline,  i.e.,  5  additional 
errors  compared  to  the  group  average.  Using  the  between-subjects  variance  and  within-subjects 
variance  as  assessed  for  the  representative  sample,  a  statement  could  be  made  about  the 
probability  of  observing  such  a  response  to  sleep  loss.  Moreover,  it  could  be  estimated  to  what 
extent  this  would  likely  be  caused  by  trait  vulnerability  to  sleep  loss,  and  to  what  extent  a 
random  fluctuation  would  likely  have  contributed.  For  instance,  if  the  between-subjects  variance 
were  somewhat  larger  than  the  within-subjects  variance  in  this  population,  then  further 
calculations  might  show  that  the  individual’s  trait  characteristics  most  probably  led  to  3 
additional  errors  in  the  response  to  sleep  loss  (as  compared  to  the  group  average),  and  that 
random  variability  most  probably  contributed  the  remaining  2  additional  errors  observed  at 
midnight. 

Thus,  even  if  nothing  is  a-priori  known  about  a  given  person,  it  is  possible  to  acquire  probability- 
based  information  regarding  that  person’s  performance  during  sleep  deprivation — owing  to  first 
having  studied  the  inter-individual  differences  in  a  sample  of  the  population  to  which  the  person 
belongs.  The  Bayesian  forecasting  procedure  can  use  this  information  to  optimize  the  parameters 
of  a  mathematical  model  of  performance  for  any  individual  of  interest.  Initially,  the  model 
parameters  would  be  set  to  those  that  would  best  describe  the  average  person  in  the  population, 
and  model  predictions  for  the  individual’s  performance  would  be  based  on  this  population- 
average  version  of  the  model.  This  makes  sense,  for  if  nothing  is  as  yet  known  about  the 
individual,  the  probability  is  greatest  that  the  individual’s  response  is  approximately  average. 
However,  if  it  is  possible  to  take  one  or  more  measurements  of  the  individual’s  performance, 
then  the  likely  contribution  of  his  or  her  actual  trait  characteristics  to  the  observed  performance 
could  be  estimated,  as  outlined  above.  Using  Bayesian  probability  statistics,  this  trait  information 
can  be  utilized  to  optimize  the  model  parameters  for  the  individual  at  hand  (Olofsen  et  ah,  2004). 
In  this  manner,  Bayesian  forecasting  allows  a  mathematical  model  to  account  for  inter-individual 
differences  even  when  performance  predictions  are  applied  to  individuals  not  studied 
beforehand. 

This  project  dealt  with  implementation  of  the  Bayesian  forecasting  procedure  for  mathematical 
modeling  of  performance,  but  also  extended  this  effort  to  simultaneously  account  for  subject- 
specific  states.  The  latter  issue  has  been  largely  overlooked  in  the  published  literature,  but  is  no 
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less  important  in  operational  settings.  For  example,  the  sleep  history  of  personnel  reporting  for  a 
mission  is  typieally  undoeumented,  and  therefore  individuals’  initial  sleep  homeostatie  state  may 
be  a-priori  unknown.  Henee,  to  be  truly  useful  and  reliable  in  operational  settings,  performanee 
models  must  also  be  able  to  deal  with  this  initial  state  uneertainty.  In  this  report,  it  is  shown  that 
this  matter  ean  be  approaehed  with  the  Bayesian  foreeasting  proeedure  as  well. 


Performance  Prediction  with  the  Two-Process  Model 


To  develop  a  tool  for  mathematieal  model  predietion  of  individual  subjeets’  performanee  in  the 
faee  of  a-priori  unknown  inter-individual  differenees  in  traits  as  well  as  uneertain  states,  the 
seminal  two-proeess  model  of  sleep  regulation  (Borbely,  1982;  Borbely  and  Aehermann,  1999) 
was  used  as  a  model  platform.  The  two-proeess  model  postulates  two  primary  sleep/wake 
regulatory  proeesses:  a  sinusoidal  circadian  process  and  a  saturating  exponential  homeostatic 
process. 

The  equation  for  the  eireadian  proeess  C  is  a  elosed-form  equation  of  the  form: 

C{t)  =  '^aj^sm{2kn{t-(p)l  t),  (1) 

k 

where  t  denotes  eloek  time  (in  hours,  relative  to  midnight),  ^  is  a  parameter  for  the  eireadian 
phase  angle  (i.e.,  the  timing  of  the  eireadian  proeess  relative  to  eloek  time),  and  r  is  a  parameter 
for  the  eireadian  period.  Sinee  eireadian  phase  shifts  and  temporary  ehanges  in  the  eireadian 
period  are  mathematieally  equivalent  (Van  Dongen  et  ah,  1998),  x  is  redundant  with  cp  in  most 
operational  environments,  and  is  therefore  fixed  here  at  r  =  24h.  The  summation  over  the  index  k 
serves  to  allow  for  harmonies  in  the  sinusoidal  shape  of  the  eireadian  proeess.  For  applieation  of 
the  two-proeess  model  for  alertness  predietion.  A:  has  been  taken  to  go  from  1  to  5,  with  the 
eonstants  at  being  fixed  as  ai  =  0.97,  ai  =  0.22,  03  =  0.07,  04  =  0.03,  and  as  =  0.001  (Aehermann 
and  Borbely,  1994). 

The  equation  for  the  homeostatie  proeess  S  during  wakefulness  is  a  differenee  equation  of  the 
form: 

(2) 

{S  >  0),  where  t  denotes  (eumulative)  eloek  time.  At  denotes  the  time  step  (of  arbitrary  length, 
but  typieally  taken  as  At  =  0.5h),  and  Xr  represents  the  time  eonstant  for  the  build-up  of  the 
homeostatie  proeess  during  wakefulness.  For  the  present  purposes,  only  eonsolidated  periods  of 
wakefulness  are  eonsidered;  the  equation  for  S  during  sleep  is  therefore  not  discussed  here. 


By  replacing  time  constant  with  an  equivalent  rate  constant  p,  and  substituting  S  with  reversed 
sign  (i.e.,  5*  <  0)  for  S'  -  1,  Eq.  (2)  can  be  simplified  to: 

S,=S,_,,e-^^‘.  (3) 

Iteratively  tracking  this  difference  equation  back  in  time  to  an  arbitrary  modeling  start  time  to,  it 
follows  that: 

S{t)  =  ^  (4) 


where  ^  is  the  initial  homeostatic  state  (i.e.,  at  time  to).  Here,  we  select  to  to  be  the  time  of  the 
most  recent  awakening,  and  so  ^  represents  the  homeostatic  state  upon  awakening. 
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As  conceptualized  by  Aehermann  and  Borbely  (1994),  performance  may  be  modeled  by 
assuming  an  additive  interaction  of  the  eircadian  and  homeostatie  proeesses.  The  general 
equation  for  this  would  be; 

P{t)  =  /3  S{t)  +  r  C{t)  +  K,  (5) 

where  P  is  the  predieted  level  of  performance,  is  a  parameter  for  the  relative  impact  of  the 
homeostatie  process  on  performance,  and  y  is  a  parameter  for  the  amplitude  of  the  effect  of  the 
circadian  process  on  performance.  The  intercept  parameter  k  offsets  the  two  processes  and 
thereby  modulates  the  basal  performance  level.  Substituting  Eqs.  (1)  and  (4)  into  Eq.  (5),  and 
noting  that  ji  is  redundant  with  ^  (i.e.,  they  only  occur  together  as  and  may  therefore  be 
replaced  by  a  single,  rescaled  parameter  it  follows  that: 

P{t)  =  ^  ^  -I-  a^.  sm{2kn{t  -(p)l  t)  +  k.  (6) 

k 

The  free  parameters  in  this  performance  model  are  p,  y,  k,  ^  and  cp.  There  is  experimental 
evidence  that  the  homeostatie  build-up  rate  p  (Einelli  et  al.,  2000;  Aeschbaeh  et  al.,  2001),  the 
cireadian  amplitude  y  (Van  Dongen  et  al.,  2004a,  footnote  a),  and  the  basal  performance  level  as 
determined  by  k  (Kane  and  Engle,  2002)  depend  on  individual  subjects’  trait  characteristics. 
These  parameters  are  therefore  considered  trait  parameters. 

The  homeostatic  state  and  the  cireadian  phase  cannot  normally  be  considered  trait  parameters; 
they  may  change  for  any  given  individual  depending  on  the  circumstances  (e.g.,  due  to  reeent 
sleep  loss  and/or  circadian  phase  shifting  from  a  bout  of  shift  work)  and  are  therefore  state 
parameters.  However,  within  a  eonsolidated  period  of  wakefulness,  the  initial  homeostatic  state 
^  (i.e.,  the  homeostatie  state  at  the  time  of  the  most  recent  awakening  to)  is  not  subjeet  to  change. 
Thus,  the  initial  homeostatie  state  is  an  enduring  condition.  Although  the  initial  homeostatic  state 
cannot  be  inferred  from  population-based  data,  its  enduring  quality  makes  it  otherwise 
indistinguishable  from  a  trait  for  the  purpose  of  parameter  estimation  with  the  Bayesian 
foreeasting  proeedure.  When  applying  that  proeedure  to  a  eonsolidated  period  of  wakefulness, 
therefore,  the  parameter  ^  may  be  treated  as  equivalent  to  a  trait  parameter.  This  important 
property  is  implied  throughout  this  report  whenever  the  term  initial  state  parameter  is  used. 

In  general,  the  circadian  phase  angle  cannot  be  considered  an  enduring  condition — for  many 
operational  settings,  especially  those  involving  shift  work  or  transmeridian  travel,  this  would  be 
a  poor  approximation  of  reality.  However,  while  it  is  possible  to  deal  with  transitory  states  in  the 
Bayesian  forecasting  procedure,  this  goes  beyond  the  seope  of  the  present  project.  The  work 
described  here  is  limited  to  those  cireumstanees  under  which  circadian  phase  angle  is  stable  and 
may  therefore  be  assumed  to  represent  an  enduring  condition.  With  this  qualification,  circadian 
phase  angle  is  not  distinguishable  from  a  trait  for  the  purpose  of  parameter  estimation  with  the 
Bayesian  forecasting  procedure.  When  applying  the  procedure,  therefore,  the  parameter  cp  is  also 
an  initial  state  parameter  whieh  may  be  treated  as  equivalent  to  a  trait  parameter. 


Population  Model  for  the  Two-Process  Model 

As  described  in  the  introduetion,  the  Bayesian  foreeasting  proeedure  makes  use  of  the  advance 
characterization  of  inter-individual  variability  in  the  population.  In  the  present  eontext,  the 
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procedure  depends  on  the  advanee  estimation  of  the  two-proeess  model  parameters  and  their 
between-subjeets  varianee  in  a  sample  of  n  subjeets  drawn  from  the  population.  It  is  assumed 
that  an  appropriate  data  set  is  available.  For  illustration  purposes,  sueh  a  data  set  is  introdueed 
later  in  this  report. 

The  two-proeess  model  parameters  and  their  between-subjeets  varianee  ean  be  estimated  on  the 
basis  of  the  available  data  using  the  following  mixed-effeets  regression  equation; 

(7) 

where  represents  the  data  for  subjeets  /  (/  =  1,  ...,  n)  at  time  points  ty  (with  j  indexing  the  data 
points),  and  Sy  stands  for  independent,  normally  distributed  residual  error  with  mean  zero  and 
varianee  Pi  is  the  subjeet-speeifie  version  of  the  performanee  model  in  Eq.  (6): 

Pi  Hij )  =  ^  +  7,  X  a,  -  ^, )  /  r)  +  /c, .  (8) 

k 

Here  pt,  jt,  Xi,  and  (pi  are  the  subjeet-speeifie  model  parameters,  and  is  the  subjeet-speeifie 
modeling  start  time. 

To  estimate  between-subjeets  variance  in  the  trait  parameters,  it  is  assumed  a  priori  that  pi  and  y, 
are  lognormally  distributed  over  subjeets  around  p^  and  yo,  respeetively,  and  that  ki  is  normally 
distributed  over  subjeets  around  kq.  It  is  also  assumed  that  there  is  no  eovariation  over  subjeets 
among  pi,  y,  and  Xj.  The  assumptions  about  the  distribution  types  for  these  “random  effects”  are 
weak  (Olofsen  et  ah,  2004).  It  is  not  eritieal  for  the  shape  of  the  assumed  distributions  to  describe 
the  data  very  preeisely,  as  the  effeet  thereof  on  the  results  of  the  Bayesian  foreeasting  proeedure 
is  limited.  Some  statistieal  and  numerieal  efficieney  may  be  gained  by  explieitly  modeling  the 
eovariation  between  pairs  of  random  effeets,  but  that  issue  is  beyond  the  scope  of  the  projeet. 

The  distributions  of  the  initial  state  parameters  and  cpt  depend  on  the  eonditions  under  whieh 
the  available  data  were  eolleeted.  Speeifieally,  for  the  data  set  introdueed  in  the  next  seetion  of 
this  report,  by  design  the  initial  homeostatic  state  f  and  the  circadian  phase  angle  cp  should  be 
approximately  the  same  for  all  subjeets — say,  <^o  and  (po,  respeetively.  (Later,  however,  for 
simulation  purposes  we  eonsider  ^  and  (p  as  uneertain.) 

Taken  together,  these  assumptions,  or  prior  distributions,  can  be  translated  into  the  following 
mathematieal  equations: 


Pi 

Po  ^  ’ 

(9a) 

Yi 

=  Yo  (P' , 

(9b) 

J^i 

-t- 

II 

(9c) 

=  4, 

(9d) 

(Pi 

=  (Po, 

(9e) 

2  2 

where  v/,  rji  and  2,  are  independent,  normally  distributed  with  means  of  zero  and  varianees  xp  ,  co 
and  7^,  respeetively.  Charaeterization  of  the  trait  inter-individual  variability  in  the  population  in 
the  framework  of  the  two-process  model  thus  entails  the  assessment  of  the  normal  distributions 
for  Vi,  rji,  and  2/  by  estimating  the  parameters  \p  ,  co  and/  .  For  referenee  purposes,  the  relevant 
model  parameters  are  reeapitulated  in  Table  1. 
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Table  1:  Summary  deseriptions  of  the  trait  parameters  (distinguishing  their  fixed  effeets,  the  assoeiated  subjeet- 
speeifie  random  effeets,  and  the  varianees  thereof  aeross  the  population)  and  other  model  parameters  (initial  state 
parameters,  residual  error)  involved  in  the  Bayesian  foreeasting  proeedure. 


Trait  Parameters 


State  Parameters 
Residual  Error 


Homeostatic  build-up  rate 

Circadian  amplitude 

Basal  performance  level 

Initial  homeostatic  state 
Circadian  phase  angle 
Error  variance 


p  (fixed  effect) 

V  (random  effect) 
xi?  (population  variance) 
y  (fixed  effect) 

1]  (random  effect) 

Q)^  (population  variance) 
K  (fixed  effect) 

X  (random  effect) 

(population  variance) 
^  (subject-specific) 

(p  (subject-specific) 
cP'  (population  variance) 


Substitution  of  Eqs.  (8)  and  Error!  Reference  source  not  found,  into  Eq.  (7)  leads  to  the 

following  formulation  of  the  mixed-effeets  regression  equation; 

y,j  =  ^  S ^ .  sin(2^;r(t .. -(p^)l r)  +  K^+ X.+s^j.  (9) 

k 

The  parameters  of  this  regression  equation  ean  be  estimated  by  means  of  maximum  likelihood 
estimation.  Eet  the  probability  density  funetion  (pdf)  of  a  normal  distribution  with  mean  m  and 
varianee  s  for  a  variable  x  be  denoted  as  p[x',  m,  s  ].  The  likelihood  U  of  observing  the  datay^y  for 
a  given  subjeet  i  ean  be  expressed  as  a  funetion  of  the  regression  parameters,  as  follows: 

t  (Pti .  j'ti . 'fo .  4 .  n .  r . '7, .  = 

sin(2A:;r(t,^  -cp^)! t)  + X.,  cr^],  ^ ^ 

j  k 

where  is  the  varianee  of  the  residual  error,  and  c  is  an  (irrelevant)  normalization  eonstant. 

Integration  over  the  assumed  normal  distributions  for  v/,  rji  and  2,  to  aeeount  for  the  relative 
probabilities  of  all  possible  values  of  these  parameters  yields  the  marginal  likelihood  Ly. 

p[vp,  0,(^4  p[rip,  0,0)^]  p[Xp,  0,z^]  dv,  dri-  dX„ 

Vi  r/i  Aj 

where  the  integrals  eaeh  run  from  -oo  to  oo,  and  C  is  an  (irrelevant)  normalization  eonstant.  It 
follows  that  the  likelihood  L  of  observing  the  entire  data  set,  for  all  subjeets  eolleetively,  ean  be 
expressed  as  a  funetion  of  the  regression  parameters,  as  follows: 


Maximum  likelihood  estimation  entails  assessment  of  those  parameter  values  that  would  make  it 
maximally  likely  for  the  data  to  be  observed  as  they  were,  i.e.,  those  parameters  that  maximize  L. 
This  is  typieally  done  by  minimizing  -2  log  L,  whieh  is  equivalent  to  maximizing  L  but  is  easier 
to  perform  numerieally.  The  ensuing  parameter  estimates  establish  what  is  ealled  the  population 
model.  Here,  the  population  model  eharaeterizes  the  eonsistent  ehanges  in  performanee  over  time 
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according  to  the  two-process  model,  the  systematie  between-subjeets  varianee  (i.e.,  trait-like 
variability)  in  the  parameters  of  the  two-proeess  model,  and  the  residual  within-subjeets  varianee 
(i.e.,  error  varianee)  in  the  sample  representing  the  population. 


Bayesian  Forecasting  with  Unknown  Traits  and  Uncertain  States 

Once  the  population  model  has  been  established,  it  can  be  used  in  the  Bayesian  forecasting 
procedure  to  optimize  the  parameters  of  the  two-process  model  and  to  make  subject-specific 
predictions  of  future  performance  for  an  individual  not  studied  beforehand.  Let’s  indicate  this 
individual  with  index  “a”.  The  subject’s  trait  parameters  are  thus  represented  by  Va,  rja  and  and 
the  subject’s  initial  state  parameters  are  fa  and  (p^.  Recasting  Eq.  (9)  yields; 

Lay  =  ^  +  70^"“  X  a  ^  -(p^)l  t)  +  k^+ (1 2) 

k 

Fixing  yOo,  yo,  Ko,y/,co  ,x  and  a  at  their  established  population  values,  the  subject-specific 
parameter  optimization  task  focuses  on  estimating  Va,  ?/a,  /la,  fa  and  cp^. 

At  first,  when  no  performance  data  are  as  yet  available  for  the  subject,  the  most  likely  estimates 
for  the  subject’s  traits  are  those  that  correspond  to  the  “average”  subject  in  the  population — i.e., 
Va  =  0,  //a  =  0  and  2a  =  0.  Such  reasoning  would  not  normally  be  valid  for  the  subject’s  initial 
homeostatic  state  fa  and  circadian  phase  angle  (p^..  With  Va,  ?/a  and  2a  fixed  at  zero,  however,  Eq. 
(12)  would  reduce  to: 

fay  =  ^  f 0  z  " .  Sin(2k;z-(t,^.  -  ^ J  /  r)  +  /Tq  +  ^ 3^. ,  (13) 

k 

in  which  only  fa  and  cpa  are  free  parameters.  With  three  performance  measurements  for  the 
individual  at  hand,  first  estimates  for  the  initial  state  parameters  fa  and  cp^  can  generally  be 
obtained  from  this  equation.  This  suggests  that,  as  a  rule  of  thumb,  Bayesian  forecasting 
estimates  for  the  subject’s  model  parameters  may  begin  to  be  reliable  when  the  third 
performance  measurement  becomes  available  (and  with  every  measurement  thereafter). 


Eet  the  pdf  of  a  uniform  distribution  over  the  interval  from  a  to  h  for  a  variable  x  be  denoted  as 
m[x;  a,  b\.  Assuming  that  the  distributions  represented  by  the  parameters  Va,  ?/a,  2a,  fa  and  cp^  in 
Eq.  (12)  are  independent  of  each  other  and  of  the  noise  term  %,  a-posteriori  estimates  for  the 
state  and  trait  parameters  are  obtained  by  maximizing  the  Bayesian  expression; 

0, i  0.2f"]w[fai  Q,Ty L^,  (14) 


given  the  subject’s  available  data  jay  (/  =  1,  2,  3,  ...).  Here  4  is  the  likelihood  function  taken  from 
Eq.  (10)  with  po,  yo,  kq  and  cr^  fixed;  and  La  is  defined  analogous  to  the  marginal  likelihood  in  Eq. 

Error!  Reference  source  not  found.; 


L 


=  C 


JllJf.fe 

■"a  A  4  Pa 


0,1^"]  M?7ai  0’®"]  lKi  0’2r"]- 


(15) 


w[fai  -“’0]  w[^ai  0’^]  dv^drj^  d\  d^^  d(p^. 


Here  the  integrals  for  Va,  ?/a  and  2a  run  from  — oo  to  oo;  and  the  integrals  for  fa  and  (p^  run  from  — oo 
to  0  and  from  0  to  r,  respectively. 
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The  normal  distribution  factors  in  Eq.  (14)  represent  the  prior  probability  information  about  the 
trait  parameters,  as  engendered  in  the  population  model.  No  such  prior  information  is  available 
for  the  initial  state  parameters,  which  is  why  they  are  assigned  uniform  distributions  across  the 
ranges  of  their  possible  values.  For  the  purpose  of  maximization,  the  uniform  distributions  for  fa 
and  fa  cancel  out;  and  the  denominator  L^,  being  invariant  to  the  free  parameters  (fa,  fa,  Va,  ?/a 
and  /la)  also  cancels  out.  As  such,  for  maximization,  Eq.  (14)  may  be  simplified  to 


(16) 


Maximization  of  Eq.  (16),  using  all  the  available  performance  data  jay  for  the  subject  at  hand, 
yields  the  most  likely  estimates  for  the  parameters  fa,  fa,  Va,  ?/a  and  /la.  By  repeating  this 
maximization  (iteratively)  each  time  additional  performance  data  become  available,  the 
parameter  estimates  improve  with  every  such  update,  converging  rapidly  to  those  that 
statistically  optimally  represent  the  individual.  Consequently,  the  accuracy  of  predictions  for 
future  performance,  based  on  the  updated  parameter  estimates,  increases  progressively.  Due  to 
first  having  characterized  a  sample  of  the  population  at  large,  this  improvement  in  prediction 
accuracy  for  a  previously  unstudied  individual  occurs  much  more  efficiently  than  would  be 
possible  if  the  individualized  predictions  were  attempted  without  the  use  of  population 
information  (Olofsen  et  ah,  2004). 

As  an  additional  advantage,  Eq.  (16)  allows  estimation  of  how  accurate  the  subject-specific 
parameter  estimates  and  performance  predictions  actually  are,  via  assessment  of  (95%) 
confidence  intervals.  How  this  is  best  approached  depends  on  the  numerical  procedure  used  to 
deal  with  Eq.  (16),  and  a  detailed  discussion  is  beyond  the  scope  of  this  report  (but  see  Smith  et 
ah,  2007).  One  approach  currently  implemented  is  described  below. 


Numerical  Implementation 

A  computer  program  was  developed  for  the  numerical  maximization  of  Eq.  (16)  to  estimate  the 
parameters,  and  for  the  assessment  of  95%  confidence  intervals  for  the  parameter  estimates  and 
performance  predictions.  The  computer  program  was  written  in  Matlab  version  7.0  (The 
MathWorks,  Inc.,  Natick,  Massachusetts),  and  was  run  under  the  Microsoft  Windows  XP 
operating  system  on  a  1.7GHz  Intel  Pentium  desktop  computer. 

Eq.  (16)  was  maximized  through  a  5 -dimensional  grid  search,  which  involved  calculating  the 
outcome  across  many  combinations  of  possible  parameter  values  and  recording  the  largest 
outcome  encountered.  The  parameter  grid  was  made  up  of  Va  ranging  from  -3  to  3  in  intervals  of 
0.5;  tja  ranging  from  -2  to  2  in  intervals  of  0.25;  /la  ranging  from  -30  to  30  in  intervals  of  3; 
ranging  from  -120  to  0  in  intervals  of  15;  and  fa  ranging  from  0  to  21  in  intervals  of  3  (due  to 
the  24h  circularity  of  fa  there  was  no  need  to  evaluate  fa  at  24).  The  grid  ranges  for  the  (non¬ 
circular)  parameters  Va,  rja,  /la  and  <^a  were  selected  such  that  the  probability  density  represented 
by  Eq.  (16)  vanished  toward  the  boundaries.  To  increase  the  computational  efficiency, 
calculation  of  Eq.  (10)  as  embedded  in  Eq.  (16)  was  done  recursively,  and  the  irrelevant  constant 
c  in  the  formula  was  ignored  (i.e.,  set  to  1).  To  enhance  the  numerical  resolution  of  the  parameter 
estimates,  the  parameter  grid  was  interpolated  by  a  factor  4  in  each  dimension  using  piecewise 
cubic  splines.  The  parameter  values  corresponding  to  the  interpolated  maximum  were  entered 
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into  Eq.  (12)  (minus  the  error  term  Saj)  to  yield  the  most  probable  predietion  of  future 
performanee  (for  given  time  t). 

For  eaeh  performanee  predietion,  a  95%  eonfidenee  interval  was  ealeulated  by  first  identifying 
the  smallest  contiguous  portion  of  the  (interpolated)  parameter  grid  that  captured  95%  of  the  total 
area  under  the  curve  given  by  Eq.  (18).  All  combinations  of  parameter  values  included  in  this 
portion  of  the  grid  were  then  entered  into  Eq.  (12)  to  compute  the  corresponding  predictions  of 
future  performance  (for  given  time  t).  The  minimum  and  maximum  of  the  performance 
predictions  encountered  in  this  process  were  taken  as  estimates  of  the  boundaries  of  the  95% 
confidence  interval  (which  was  thereby  allowed  to  be  asymmetrical). 

Bayesian  95%  confidence  intervals  for  the  parameter  estimates  proper  were  derived  by 
constructing  the  marginal  pdfs.  These  are  the  pdfs  for  every  parameter  considered  individually 
while  accounting  for  the  probability  densities  of  the  other  parameters.  The  marginal  pdf  for  each 
parameter  was  computed  by  integrating  over  the  other  four  parameters  across  the  parameter  grid. 
All  marginal  pdfs  thus  obtained  were  interpolated  by  a  factor  30  using  piecewise  cubic  splines. 
Their  maxima  were  identified  in  order  to  obtain  more  precise  estimates  for  the  individual  model 
parameters.  Eastly,  95%  confidence  intervals  for  the  parameter  estimates  were  computed  by 
assessing  the  shortest  contiguous  interval  capturing  95%  of  the  area  under  the  curve  of  each 
marginal  pdf  (Sivia,  1996). 

Average  prediction  bias  (i.e.,  systematic  under-  or  over-prediction)  was  quantified  by  calculating 
the  average  difference  between  predictions  and  actual  observations.  Furthermore,  average 
prediction  error  (i.e.,  point  by  point  deviation)  was  quantified  by  computing  the  square  root  of 
the  average  squared  difference  between  predictions  and  actual  observations  (i.e.,  the  root  mean 
square  error). 


Experimental  Data  and  Corresponding  Population  Model 

To  illustrate  the  potential  of  the  Bayesian  forecasting  approach,  a  previously  established  data  set 
was  employed  to  run  simulations.  The  data  were  collected  during  a  laboratory  study  involving 
88h  of  total  sleep  deprivation,  as  described  by  Van  Dongen  and  Dinges  (2005).  During  the  sleep 
deprivation  period,  a  range  of  cognitive  performance  outcomes  was  measured  every  2h,  from 
07:30  until  23:30  three  days  later.  Performance  on  the  psychomotor  vigilance  test  (PVT)  was 
selected  as  the  outcome  measure  to  model,  because  of  demonstrated  validity  and  sensitivity  to 
the  homeostatic  and  circadian  processes  (Dorrian  et  ah,  2005).  The  number  of  lapses  (reaction 
times  >  500ms)  on  the  PVT  was  recorded  as  the  primary  outcome  variable  y. 

Data  from  n  =  10  subjects  in  the  study,  drawn  from  a  population  of  healthy  males  aged  21  to  50, 
were  used  to  derive  a  population  model  based  on  the  two-process  model,  as  per  Eq.  (9).  Fig.  1 
displays  the  data  from  this  sample,  averaged  over  subjects.  As  discussed  in  Van  Dongen  and 
Dinges  (2005),  performance  deteriorated  across  days  of  sleep  deprivation  in  accordance  with  the 
homeostatic  process,  Eq.  (4),  and  varied  rhythmically  within  each  day  in  accordance  with  the 
circadian  process,  Eq.  (1).  The  average  level  of  performance  impairment  reached  after  multiple 
days  of  total  sleep  deprivation  was  considerable — it  appeared  to  exceed  the  average  level  of 
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performance  impairment  resulting  from  being  legally  intoxicated  by  alcohol  (Dawson  and  Reid, 
1997).  However,  there  were  substantial  inter-individual  differences  in  the  effects  of  sleep 
deprivation  on  psychomotor  vigilance  performance,  as  illustrated  by  the  inset  in  Fig.  1.  The  bar 
shows  the  interval  of  ±1  standard  deviation  for  systematic  between-subjects  variability, 
determined  by  mixed-effects  analysis  of  variance  (Van  Dongen  et  ah,  2004c). 

Figure  1:  Performance  measurements  during  a 
laboratory  study  involving  88h  of  total  sleep  deprivation, 
and  population  model  of  performance  based  on  the  two- 
process  model.  The  solid  boxes  show  the  number  of 
lapses  (reaction  times  >  500ms)  on  a  psychomotor 
vigilance  test  administered  every  2h,  averaged  over 
subjects  (n  =  10).  Upwards  in  the  graph  corresponds  to 
greater  performance  impairment.  The  thin  curve  shows 
the  population  model  as  plotted  for  the  “average” 
subject.  The  averaged  data  are  captured  well  by  this 
curve.  However,  the  averaged  data  do  not  show  the 
considerable  inter-individual  differences  throughout  the 
sleep  deprivation  period.  The  bar  in  the  inset  depicts  the 
interval  of  ±1  standard  deviation  for  between-subjects 
12  24  36  48  60  72  84  96  variability  in  the  data.  Although  difficult  to  illustrate 

cumulative  clock  time  (hours)  graphically,  these  inter-individual  differences  are 

captured  well  by  the  population  model  also. 

The  population  model  was  assessed  using  Eqs.  Error!  Reference  source  not  found,  through 
(1 1),  as  evaluated  with  the  eomputer  software  NONMEM  version  V  (GloboMax  EEC,  Hanover, 
Maryland).  Time  t  was  expressed  as  eumulative  eloek  time  (in  hours)  with  time  0  defined  as  the 
midnight  preeeding  the  total  sleep  deprivation  period.  The  sleep  deprivation  began  at  07:30,  and 
this  time  point  was  used  to  define  the  modeling  start  time,  so  that  to  =  7.5  for  all  subjeets.  Subjeet 
seleetion  eriteria  and  experimental  eontrols  (Van  Dongen  and  Dinges,  2005)  standardized  the 
initial  homeostatie  state  ^  and  eireadian  phase  angle  cp  at  the  beginning  of  sleep  deprivation.  Eor 
the  purpose  of  assessing  the  population  model,  therefore,  these  two  parameters  were  eonsidered 
the  same  for  all  10  subjeets  in  the  sample.  The  eireadian  phase  angle  was  relatively  stable  during 
the  88h  of  total  sleep  deprivation  (Van  Dongen  et  ah,  1998),  indieating  that  the  initial  state 
parameter  cp  represented  an  enduring  eondition  under  these  eireumstanees. 

The  parameter  estimates  (±  standard  errors)  for  the  population  model  were  found  to  be  as 
follows:  po  =  0.0350  (±  0.0156),  yo  =  4.30  (±  1.05),  kq  =  29.7  (±  3.7),  6  =  -28.0  (±  4.4),  =  0.6 

(±  0.2),  y?=\.\5{±  0.41),  m  =  0.294  (±  0.191),/  =  36.2  (±  26.2),  and  a  =  77.6  (±  7.3).  Eig.  1 
shows  that  the  population  model  elosely  matehed  the  data  as  averaged  over  subjeets.  Not  readily 
observed  in  Eig.  1  is  that  the  population  model  also  matehed  the  data  of  the  individual  subjeets 
well,  sinee  the  parameters  of  the  population  model  were  optimized  relative  to  the  data  of  the 
whole  sample  of  n  =  10  subjeets  without  averaging  out  the  eonsiderable  inter-individual 
differenees.  Compared  to  the  same  model  without  inter-individual  differenees,  the  population 
model  redueed  the  residual  error  varianee  by  a  faetor  1.64. 

The  population  model  deseribed  here  eharaeterized  the  ehanges  in  performanee  during  total  sleep 
deprivation  in  aeeordanee  with  the  two-proeess  model,  as  well  as  the  inter-individual  differenees 
in  the  model  parameters,  and  the  residual  error,  in  a  population  of  healthy  males  aged  21  to  50. 
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This  provided  all  the  information  neeessary  to  run  simulations  for  the  Bayesian  foreeasting 
proeedure,  in  order  to  demonstrate  the  predietability  of  individual  subjeets’  performanee  in  the 
faee  of  a-priori  unknown  traits  and  uneertain  states. 


Bayesian  Forecasting  Simulations 

Besides  the  ten  subjeets  used  to  establish  the  population  model,  three  additional  subjeets  drawn 
from  the  same  population  partieipated  in  the  total  sleep  deprivation  study  deseribed  above.  These 
three  subjeets  were  seleeted  to  represent  eonsiderable  inter-individual  differenees  in  performanee 
impairment  during  sleep  deprivation,  and  their  data  were  set  aside  prospeetively  to  run 
simulations  with  the  Bayesian  foreeasting  proeedure.  The  trait  parameters  Va,  ?/a  and  /la  for  these 
subjeets  were  not  known  a  priori.  Furthermore,  even  though  the  initial  state  parameters  fa  and  cp^ 
were  approximately  the  same  for  all  subjeets  due  to  the  design  of  the  study  (Van  Dongen  and 
Binges,  2005),  for  the  purposes  of  simulations  these  parameters  were  eonsidered  uneertain. 

The  objective  of  the  first  of  our  simulations  was  to  make  predictions  of  the  three  subjects’ 
performance  during  total  sleep  deprivation,  at  Ih  intervals  for  up  to  24h  in  the  future  (i.e.,  24h- 
ahead  predictions);  and  to  update  the  predictions  using  Bayesian  forecasting  each  time  the  next 
performance  measurement  became  available.  The  population  model  parameters  yOo,  yo,  kq,  y?,  o?, 
/  and  a  remained  fixed  at  their  previously  established  population  averages  (see  the  previous 
section).  Modeling  start  time  tao  was  fixed  at  7.5  (i.e.,  07:30,  the  scheduled  time  of  awakening). 
Time  ty  was  incremented  in  2h  steps  beginning  at  tao,  so  as  to  coincide  with  the  time  points  for 
data  collection  in  the  sleep  deprivation  experiment.  At  each  increment,  parameter  estimates  were 
updated  by  maximizing  Eq.  (16)  using  the  numerical  approach  outlined  previously.  With  the 
updated  parameter  estimates,  Eq.  (12)  (minus  the  error  term  %)  was  evaluated  at  Ih  intervals 
from  taj  to  taj  +  24  in  order  to  predict  performance  up  to  a  24h  prediction  horizon. 

Eig.  2  shows  the  results  of  the  simulation,  in  snapshots  taken  at  8h  intervals.  The  three  subjects 
are  indicated  as  “A”,  “B”  and  “C”.  The  first  snapshot  (top  row  panels  in  Eig.  2)  occurred  at 
1 1 :30,  at  4h  awake,  when  the  third  performance  measurement  was  taken.  Based  on  the  rule  of 
thumb  suggested  by  Eq.  (13),  this  is  the  first  occasion  when  there  may  have  been  enough  data 
points  (black  circles)  to  reasonably  estimate  the  initial  state  parameters  fa  and  cpa-  Even  at  this 
early  stage,  the  24h  predictions  for  the  three  subjects  (solid  curves)  were  already  notably 
different,  accounting  with  remarkable  accuracy  for  the  different  performance  profiles  that  would 
subsequently  be  observed  in  the  actual  measurements  (gray  circles).  However,  the  95% 
confidence  intervals  for  the  performance  predictions  were  still  large.  The  last  snapshot  (bottom 
row  panels  in  Eig.  2)  was  taken  40h  later,  well  before  the  end  of  the  88h  sleep  deprivation  period, 
but  sufficiently  far  along  for  the  present  purposes.  By  this  time  (i.e.,  at  44h  awake),  the  24h 
predictions  had  diverged  substantially  among  the  three  subjects,  as  had  the  actual  observations. 
Also,  the  95%  confidence  intervals  for  the  performance  predictions  were  much  narrower.  There 
was  no  overlap  between  the  95%  confidence  intervals  for  subjects  B  and  C  at  any  of  the 
evaluated  time  points  (at  Ih  intervals)  across  the  24h  prediction  horizon  (center  and  right  bottom 
panels  in  Eig.  2).  This  implies  that  at  44h  awake,  the  predictions  for  these  two  individuals  were 
statistically  distinct  with  a  type  I  error  of  much  less  (Payton  et  ah,  2003)  than  0.05  for  every 
prediction  time  point. 
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f  =  n.j 
(time  1 1 :30) 

I  -  („  =  -1.0 
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(time  19:30) 
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(awake  12h) 
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(lime  51:30) 
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Figure  2:  Simulation  using  the  Bayesian  foreeasting  proeedure  to  prediet  performanee  over  time  for  three 
individuals  exposed  to  aeute  total  sleep  deprivation.  Eaeh  eolumn  of  panels  represents  a  different  individual.  Subjeet 
“A”  exhibited  a  fairly  average  response  to  sleep  deprivation  (ef  Fig.  1);  subjeet  “B”  displayed  eonsiderable 
resistanee  to  the  effeets  of  sleep  deprivation;  and  subjeet  “C”  had  relatively  high  vulnerability  to  performanee 
impairment  due  to  sleep  deprivation.  However,  these  subject-speeifie  eharaeteristies  were  not  elear  in  advanee — in 
this  simulation,  the  trait  parameters  v,  rj  and  1  were  assumed  a-priori  unknown,  and  the  initial  state  parameters  ^  and 
(p  were  eonsidered  a-priori  uneertain  as  well.  The  first  row  of  panels  shows  the  performanee  predietions  for  eaeh  of 
the  three  individuals  upon  aequisition  of  the  third  performanee  measurement,  at  4h  awake  (11:30  eloek  time).  The 
blaek  eireles  show  the  number  of  lapses  (reaetion  times  >  500ms)  on  a  psyehomotor  vigilanee  test  administered 
every  2h  up  to  that  time  point.  The  thiek  eurve  shows  the  psyehomotor  vigilanee  performanee  predietions  for  the 
subsequent  24h  period.  The  thin  vertieal  lines  display  the  eorresponding  95%  eonfidenee  intervals  (in  Ih  steps).  For 
eomparison,  the  gray  eireles  show  the  aetual  performanee  measurements  during  the  24h  predietion  period.  (Sinee 
this  was  a  simulation  based  on  data  aequired  previously,  these  observations  were  already  known,  even  though  they 
were  not  yet  made  available  to  the  Bayesian  foreeasting  proeedure.)  Note  that  any  data  points  that  visually  seem  to 
be  missing  have  the  predietion  eurve  right  on  top  of  them.  The  seeond  row  of  panels  shows  the  situation  8h  later, 
when  four  additional  performanee  measurements  were  available  and  the  model  parameters  had  been  updated 
aeeordingly  by  the  Bayesian  foreeasting  proeedure.  The  third  through  sixth  rows  show  the  situation  in  further  8h 
inerements. 
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Since  the  sleep  deprivation  study  took  plaee  in  the  past  and  all  the  data  were  already  available, 
the  simulation  predietions  eould  be  eompared  direetly  to  aetual  observations  of  performanee 
impairment.  Looking  at  all  the  snapshots  in  sueeession  (from  top  to  bottom  through  Fig.  2),  the 
performanee  responses  to  sleep  deprivation  varied  systematieally  among  the  three  individuals. 
The  model  predietions  were  progressively  tailored  to  these  subjeet-speeifie  responses,  and  the 
95%  eonfidenee  intervals  eonsistently  redueed  in  size,  revealing  a  steady  inerease  in  model 
preeision.  Of  eourse,  this  does  not  mean  that  the  predietions  were  highly  aeeurate  throughout. 
Oeeasionally,  performanee  at  speeifie  time  points  was  eonsiderably  under-  or  over-predieted. 
However,  the  observations  at  those  time  points  typieally  stood  out  from  the  surrounding  data 
points,  and  did  not  fit  the  expeeted  profile  of  gradual  ehange  over  time  in  aeeordanee  with  the 
homeostatie  and  eireadian  proeesses.  Whether  these  data  points  represent  outliers  or  whether 
they  may  refleet  systematie  aspeets  of  performanee  regulation  not  eaptured  by  the  two-proeess 
model  is  diffieult  to  establish.  Ultimately,  the  Bayesian  foreeasting  proeedure  ean  only  prediet 
performanee  as  aeeurately  as  allowed  by  the  eomprehensiveness  of  the  mathematieal  model  in 
which  it  is  implemented,  and  the  quality  of  the  data  it  uses  to  update  the  model  parameters. 

Given  these  eaveats,  the  simulation  demonstrated  a  high  degree  of  sueeess  in  predieting 
performanee  24h  ahead  during  laboratory  sleep  deprivation. 

Fig.  3  shows  the  evolution  of  the  model  parameter  estimates  with  every  step  in  the  simulation, 
from  4h  awake  up  to  70h  awake,  for  subjeet  “A”.  The  figure  illustrates  that  the  three  trait 
parameters  as  well  as  the  two  initial  state  parameters  eould  be  estimated  with  inereasing 
preeision  as  more  data  beeame  available  over  time.  However,  this  “sharpening  up”  of  the 
parameter  estimates  did  not  always  oeeur  in  a  gradual  fashion.  Oeeasional  abrupt  ehanges 
refleeted  variability  in  how  informative  the  newly  aequired  performanee  data  were  for  the 
parameters  in  question.  After  about  50h  of  wakefulness,  there  was  hardly  any  new  information  in 
the  performanee  data,  and  the  parameters  eonverged  on  their  best  estimable  values.  The 
estimates  of  the  trait  and  initial  state  parameters  for  eaeh  of  the  three  subjeets  at  the  end  of  the 
simulation,  after  88h  of  total  sleep  deprivation,  are  shown  in  Table  2.  For  eomparison,  the 
population  averages  of  the  trait  parameters  were  zero  by  definition,  and  the  population  averages 
of  the  initial  state  parameters  were  <^o  =  -28.0  and  cpo  =  0.6. 

Table  2:  Estimates  of  the  trait  and  initial  state  parameters  for  the  three  individual  subjects,  as  converged  on  after 
88h  of  total  sleep  deprivation  in  computer  simulations  starting  at  awakening. 


Individual 

Trait  Parameters 

V  t]  X 

State  Parameters 

^  9 

A 

0.12 

0.75 

2.8 

-44.5 

0.0 

B 

-2.37 

-0.44 

-3.1 

-30.0 

3.3 

C 

0.88 

-0.13 

3.5 

-39.5 

-2.8* 

*Even  though  circadian  phase  angle  (p  was  estimated  in  the  range  from  0  to  24,  it  is  shown  here  on  a  scale  from  -12 
to  12  to  facilitate  comparison  among  individuals. 

It  is  instructive  to  assess  the  performanee  predietion  aeeuraey  of  the  Bayesian  foreeasting 
proeedure  relative  to  that  of  the  population  average  model  (i.e.,  with  the  traits  and  initial  states 
fixed  at  the  estimates  obtained  when  establishing  the  population  model).  The  latter  is  illustrated 
in  Fig.  4  for  a  snapshot  taken  at  44h  of  wakefulness.  A  visual  eomparison  of  this  simulation  with 
the  one  in  Fig.  2  (last  row  panels)  suggests  that  using  the  population  average  model  had  limited 
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consequences  for  subject  “A”  (because  this  subject’s  response  to  sleep  deprivation  turned  out  to 
be  approximately  average),  but  resulted  in  substantial  over-prediction  of  performance 
impairment  for  subject  “B”  and  under-prediction  of  performance  impairment  for  subject  “C”. 

The  average  prediction  bias  at  44h  awake  for  the  three  subjects  combined  was  -4.4  lapses,  and 
the  average  prediction  error  was  16.3  lapses.  In  contrast,  for  the  simulation  with  the  Bayesian 
forecasting  procedure  (Fig.  2),  the  average  prediction  bias  at  44h  awake  was  only  -0.2  lapses, 
and  the  average  prediction  error  was  8.0  lapses.  These  numbers  demonstrate  the  improvement 
achieved  by  using  the  Bayesian  forecasting  procedure  to  predict  performance  under  conditions  of 
unknown  traits  and  uncertain  states. 

Because  the  three  subjects  set  aside  for  simulations  were  taken  from  the  same  study  as  the  ten 
subjects  used  to  establish  the  population  model,  their  initial  homeostatic  and  circadian  state 
parameters  may  have  been  relatively  close  to  the  population  averages.  Indeed,  the  parameter 
values  at  the  end  of  the  simulation  (Table  2)  confirmed  this.  To  rule  out  that  our  evaluation  of  the 
Bayesian  forecasting  procedure  under  conditions  of  state  uncertainty  constituted  a  poor  test 
because  of  this,  another  simulation  was  run  similar  to  the  first  one  (Fig.  2),  but  starting  at  a 
different  homeostatic  state.  This  was  accomplished  by  ignoring  the  first  24h  of  sleep  deprivation 
and  the  performance  data  collected  during  this  period,  and  beginning  the  simulation  at  =  31.5 
(i.e.,  07:30  on  the  second  day  of  sleep  deprivation).  All  other  aspects  of  the  simulation  were  kept 
the  same. 

Fig.  5  shows  the  results  of  this  new  simulation  for  subject  “A”,  in  snapshots  taken  at  8h  intervals. 
In  terms  of  time  spent  awake,  the  top  panel  in  Fig.  5  corresponds  to  the  fourth  panel  in  the  left 
column  of  Fig.  2 — ^both  represent  the  situation  at  28h  awake.  Since  the  performance  data 
acquired  during  the  first  24h  of  wakefulness  were  ignored  in  the  new  simulation,  however,  the 
24h  performance  predictions  made  at  28h  awake  were  slightly  different,  and  the  95%  confidence 
intervals  were  much  larger.  Still,  over  time  (from  top  to  bottom  through  Fig.  5),  the  Bayesian 
forecasting  procedure  displayed  the  same  behavior,  progressively  tailoring  the  predictions  to  the 
subject-specific  responses  with  the  95%  confidence  intervals  consistently  reducing  in  size.  At 
44h  of  wakefulness  (i.e.,  the  third  snapshot),  the  average  prediction  bias  across  all  three  subjects 
was  -1.5  lapses,  and  the  average  prediction  error  was  8.9  lapses — not  much  different  from  the 
first  simulation  (Fig.  2)  and  still  much  better  than  the  population  average  model  simulation  (Fig. 
4).  The  estimates  of  the  trait  and  initial  state  parameters  for  each  of  the  three  subjects  at  the  end 
of  the  simulation,  after  88h  of  total  sleep  deprivation,  are  shown  in  Table  3.  By  and  large,  these 
estimates  are  close  to  those  obtained  in  the  first  simulation  (Table  2).  These  results  confirm  that 
the  Bayesian  forecasting  procedure,  as  extended  by  us  from  the  trait-only  procedure  presented  by 
Olofsen  et  al.  (2004),  can  handle  the  a-priori  uncertainty  of  initial  states  well. 

Table  3:  Estimates  of  the  trait  and  initial  state  parameters  for  the  three  individual  subjeets,  as  eonverged  on  after 
88h  of  total  sleep  deprivation  in  eomputer  simulations  starting  24h  after  awakening. 


Individual 

Trait  Parameters 

V  t]  1 

State  Parameters 

f  (P 

A 

0.47 

0.76 

0.0 

-44.5 

0.0 

B 

-2.05 

-0.32 

-3.9 

-31.0 

3.2 

C 

1.38 

0.11 

3.4 

* 

-3.0 

eould  not  be  estimated  from  subjeet  C’s  data  after  24h  of  wakefulness,  as  this  parameter  no  longer  had  a 
notieeable  effeet  on  the  subjeet’s  performanee  predietions. 
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Subject  A 


time  awake  (h) 


Figure  3:  Bayesian  foreeasting  estimates  of  the  trait  and  initial  state  parameters 
for  subject  “A”.  This  figure  illustrates  the  optimization  process  for  the  estimates 
of  trait  parameters  v,  rj  and  1  and  initial  state  parameters  ^  and  (p  during  the 
simulation  shown  in  Fig.  2.  The  panels  display  the  parameter  estimates 
(diamonds)  with  95%  confidence  intervals  (vertical  bars),  as  updated  upon  the 
availability  of  new  performance  measurements  at  2h  intervals  (beginning  with 
the  third  measurement  at  4h  of  wakefulness).  Note  that  even  though  circadian 
phase  angle  (p  was  estimated  in  the  range  from  0  to  24,  it  is  plotted  here  (last 
panel)  on  a  scale  from  -12  to  12  to  facilitate  visual  interpretation.  The 
confidence  intervals  for  the  first  two  estimates  of  (p  extend  below  the  bottom  of 
the  panel,  and  are  continued  at  the  top  of  the  panel  because  of  the  circular 
nature  of  this  parameter.  For  reference  purposes,  the  open  diamonds  mark  the 
parameter  estimates  that  were  underlying  the  performance  predictions  for 
subject  “A”  as  shown  successively  in  the  six  panels  in  the  left  column  of  Fig.  2. 
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Figure  4:  Simulation  using  the  population  model  based  on  the  two-process  model  to  predict  performance  over  time, 
without  employing  the  Bayesian  forecasting  procedure.  Details  are  the  same  as  for  the  last  row  of  panels  (awake 
44h)  in  Fig.  2,  except  that  the  state  and  trait  parameters  of  the  performance  prediction  model  remained  fixed  at  their 
population  averages  and  were  not  updated  based  on  subject-specific  performance  information  acquired  during  the 
sleep  deprivation  period.  As  a  consequence,  the  performance  predictions  were  equal  for  each  individual,  and  there 
was  no  flexibility  in  the  level  or  shape  of  the  24h  predictions  curves.  Note  also  that  no  suitable  equivalent  was 
available  for  the  95%  confidence  intervals. 
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Figure  5:  Simulation  using  the  Bayesian  foreeasting  proeedure  to 
prediet  performanee  over  time  for  subjeet  “A”,  starting  at  a  later 
time  during  the  sleep  deprivation  period.  Details  are  the  same  as  for 
Fig.  2  (left  eolumn  panels),  exeept  that  here  the  initial  homeostatie 
state  was  different  beeause  the  simulation  was  started  at  24h  awake 
(but  for  the  purpose  of  the  simulation  the  amount  of  prior 
wakefulness  was  eonsidered  not  known).  Timewise,  the  top  panel  in 
this  figure  eorresponds  to  the  fourth  panel  in  the  left  eolumn  of  Fig. 
2.  The  seeond  through  sixth  panels  display  the  updated  24h 
performanee  predietions  as  time  passed,  shown  in  8h  inerements. 
Note  that  there  were  only  nine  aetual  observations  (gray  eireles)  to 
eompare  to  in  the  last  panel,  beeause  data  aequisition  stopped  at  88h 
awake  in  the  laboratory  experiment. 


Critical  for  the  usefulness  of  the  Bayesian  forecasting  procedure  in  operational  settings  is  its 
ability  to  deal  with  sparse  data,  collected  infrequently  at  intervals  of  potentially  unequal  duration. 
To  examine  this  property,  another  simulation  was  conducted,  similar  again  to  the  first  one  (and 
starting  at  Co  =  7.5),  but  using  only  the  performance  measurements  of  8  (instead  of  23)  randomly 
selected  time  points  to  updated  the  model  parameters.  Fig.  6  shows  the  results  of  this  simulation 
for  subject  “A”,  again  in  snapshots  taken  at  8h  intervals.  In  terms  of  time  spent  awake,  the  top 
panel  in  Fig.  6  corresponds  to  the  second  panel  in  the  left  column  of  Fig.  2 — both  represent  the 
situation  at  12h  awake  (at  4h  awake  there  were  not  enough  data  points  yet  to  expect  reasonable 
estimates  for  the  initial  state  parameters). 


The  scarcity  of  data  in  the  simulation  of  Fig.  6  caused  the  24h-ahead  prediction  curve  at  12h 
awake  to  be  notably  different  than  in  the  first  simulation  (Fig.  2).  The  95%  confidence  intervals 
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were  larger  as  well.  However,  as  the  simulation  progressed  (from  top  to  bottom  through  Fig.  6), 
the  24h  predictions  became  very  similar  to  those  seen  in  the  first  simulation.  At  44h  awake,  the 
average  prediction  bias  across  all  three  subjects  was  -0.5  lapses,  and  the  average  prediction  error 
was  8.5  lapses — again  similar  to  what  was  found  in  the  first  simulation  (Fig.  2).  The  estimates  of 
the  trait  and  initial  state  parameters  for  each  of  the  three  subjects  at  the  end  of  the  simulation, 
after  88h  of  total  sleep  deprivation,  are  shown  in  Table  4.  These  are  also  close  to  the  estimates 
obtained  in  the  first  simulation  (Table  2).  Thus,  the  main  effect  of  the  data  being  sparse  appeared 
to  be  that  the  95%  confidence  intervals  reduced  in  size  less  rapidly,  but  the  Bayesian  forecasting 
procedure  did  not  lose  its  ability  to  predict. 

Table  4:  Estimates  of  the  trait  and  initial  state  parameters  for  the  three  individual  subjeets,  as  eonverged  on  after 
88h  of  total  sleep  deprivation  in  eomputer  simulations  with  sparse  data. 


Individual 

Trait  Parameters 

V  t]  1 

State  Parameters 

f  <P 

A 

0.48 

0.58 

2.6 

-48.0 

0.0 

B 

-1.97 

-0.25 

-4.1 

-30.5 

5.6 

C 

0.35 

-0.17 

0.4 

-26.0 

2.6 
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Figure  6:  Simulation  using  the  Bayesian  foreeasting  proeedure  to 
prediet  performanee  over  time  for  subjeet  “A”,  under  eonditions  of 
sparse  data  availability.  A  large  portion  of  the  original  data  set  (see 
Fig.  2,  left  eolumn  panels)  was  disearded  here,  so  as  to  simulate  that 
the  available  performanee  measurements  oeeurred  infrequently — at 
random,  unequally  spaeed  intervals.  Other  details  are  the  same  as  for 
Fig.  2,  exeept  that  the  first  panel  in  that  figure  (awake  4h)  is  not 
repeated  beeause  only  one  data  point  was  available  during  the  first  4h 
of  wakefulness  in  this  simulation. 
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Repeated  Use  of  Bayesian  Forecasting 

After  the  Bayesian  forecasting  procedure  has  been  applied  to  make  performance  predictions  for  a 
given  individual,  the  optimized  values  for  the  trait  parameters  (but  not  the  initial  state 
parameters)  can  be  used  again  if  predictions  are  needed  for  this  same  individual  on  another 
occasion.  Specifically,  the  prior  normal  distributions  for  the  trait  parameters  v„  rjt  and  Xi  in  Eq. 
(16)  can  be  replaced  by  the  pdfs  obtained  for  these  parameters  at  the  end  of  the  previous 
application  of  the  Bayesian  forecasting  procedure.  This  way,  the  data  acquired  for  an  individual 
during  scenarios  in  the  past  continue  to  contribute  to  the  precision  of  the  performance  predictions 
for  that  individual  in  the  future. 

To  examine  this  idea,  a  simulation  was  run  using  data  from  a  different  experiment  (study  2  in 
Van  Dongen  et  ah,  2005a).  A  person  was  exposed  to  36h  total  sleep  deprivation  in  the  laboratory 
on  two  occasions.  Laboratory  circumstances  were  similar  to  those  encountered  in  the  other 
simulations.  However,  the  36h  sleep  deprivations  began  at  10:00,  and  this  time  point  was  used  to 
define  the  modeling  start  time  for  each  sleep  deprivation  period  (i.e.,  to  =  10).  Psychomotor 
vigilance  testing  occurred  at  2h  intervals,  beginning  at  10:30  {t  =  10.5),  during  both  sleep 
deprivations.  The  performance  data  were  very  similar  between  the  two  sleep  deprivations  (see 
Fig.  7),  as  was  anticipated  given  that  performance  responses  to  sleep  deprivation  are  overall  trait- 
like  (Van  Dongen  et  ah,  2004a).  It  was  expected  that,  despite  the  relatively  small  number  of  data 
points  available,  the  Bayesian  forecasting  procedure  would  achieve  greater  prediction  precision 
more  rapidly  for  the  second  exposure  to  sleep  deprivation  when  utilizing  the  trait  information 
obtained  in  the  first  exposure. 

The  results  of  the  simulation  are  shown  in  Fig.  7.  The  first  column  of  panels  shows  the  results  of 
Bayesian  forecasting  for  the  first  sleep  deprivation  period.  The  second  column  of  panels  shows 
the  results  for  the  second  sleep  deprivation  period  without  utilizing  the  trait  information  acquired 
in  the  first.  Although  some  data  points  were  missing  in  the  first  sleep  deprivation  session,  the 
prediction  results  and  corresponding  95%  confidence  intervals  were  nearly  identical.  The 
average  prediction  bias  was  -4.3  lapses  for  the  first,  and  -6.0  lapses  for  the  second  sleep 
deprivation;  and  the  average  prediction  error  was  1 1.2  lapses  for  the  first,  and  1 1.0  lapses  for  the 
second  sleep  deprivation.  The  third  column  of  panels  shows  the  improvement  in  the  predictions 
for  the  second  sleep  deprivation  when  employing  the  pdfs  obtained  for  the  trait  parameters  (but 
not  the  initial  state  parameters)  at  the  end  of  the  first  sleep  deprivation.  Using  these  pdfs  as  prior 
information,  the  average  prediction  bias  for  the  second  sleep  deprivation  was  reduced  to  0.5 
lapses,  and  the  average  prediction  error  was  reduced  to  6.9  lapses. 

The  improvement  stemmed  from  the  fact  that  the  trait  and  initial  state  parameters  converged 
more  rapidly  to  the  values  best  characterizing  the  individual  at  hand,  due  to  the  more  informative 
prior  distributions  for  the  trait  parameters.  As  a  result,  the  performance  predictions  became  more 
accurate,  and  the  95%  confidence  intervals  were  consistently  smaller,  than  without  the  use  of  the 
information  from  the  first  exposure  to  sleep  deprivation  (compare  the  second  and  third  columns 
in  Fig.  7).  This  illustrates  that  the  Bayesian  forecasting  procedure  can  become  more  effective 
when  used  repeatedly. 
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Second  SD  Figure  7:  Simulation  using  the  Bayesian 

foreeasting  proeedure  to  prediet 
performanee  over  time  for  a  single 
individual  exposed  to  aeute  total  sleep 
deprivation  twiee.  The  first  eolumn  of 
panels  shows  the  simulation  for  the  first 
time  the  individual  underwent  36h  sleep 
deprivation;  graphieal  details  are  the 
same  as  for  Fig.  2.  (Note  that  the  24h 
ahead  predietions  displayed  in  the  bottom 
panel  extend  beyond  the  36h  period  of 
sleep  deprivation.)  The  second  column  of 
panels  shows  the  simulation  for  the 
second  time  the  individual  was  exposed 
to  36h  sleep  deprivation,  retaining  no 
information  from  the  first  exposure.  The 
third  column  of  panels  shows  the 
1.’  .>4  :)(i  48  simulation  for  the  second  exposure  to 
time  awake  (h)  sleep  deprivation  again,  but — as  denoted 
by  the  asterisk — the  estimates  for  the 


trait  parameters  at  the  end  of  the  first  exposure  to  36h  sleep  deprivation  were  used  as  prior  information  this  time 
(although  the  initial  state  parameters  were  still  considered  a-priori  uncertain). 


Discussion 

We  demonstrated  the  usefulness  of  the  Bayesian  foreeasting  proeedure  for  predieting  eognitive 
performance  impairment  with  a  mathematical  model,  in  particular  the  two-process  model,  in  the 
face  of  unknown  trait  characteristics  and  uncertain  initial  states  in  individual  subjects. 
Prospective  computer  simulations  were  run  using  data  from  the  psychomotor  vigilance  test 
(PVT),  a  marker  of  changes  in  cognitive  performance  mediated  by  the  homeostatic  and  circadian 
processes  (Dorrian  et  ah,  2005),  as  recorded  during  a  laboratory-based  study  of  total  sleep 
deprivation.  The  simulations  showed  that  mathematical  model  parameters  converged  rapidly  to 
the  values  that  best  characterized  the  individuals  concerned,  resulting  in  substantially  improved 
performance  predictions  relative  to  the  original  version  of  the  model.  The  Bayesian  forecasting 
procedure  also  yielded  estimates  of  95%  confidence  intervals  for  the  parameter  estimates  and  for 
performance  prediction  accuracy.  The  95%  confidence  intervals  for  performance  shrunk  over 
time,  both  in  absolute  size  and  relative  to  the  differences  in  performance  predictions  among 
individuals,  resulting  in  statistically  relevant  differentiation  among  subjects — i.e.,  successfully 
individualized  performance  predictions.  Numerical  computations  were  sufficiently  fast  on  a 
Pentium-driven  desktop  computer  to  be  feasible  in  real  time  in  operational  environments  (even 
for  keeping  track  of  multiple  individuals  working  in  small  teams). 

Thus,  the  work  presented  here  provides  the  first  solution  to  some  of  the  most  significant 
challenges  in  the  development  of  mathematical  models  of  performance  for  operational  use 
(Dinges,  2004;  Friedl  et  ah,  2004):  a)  performance  prediction  for  individuals  (instead  of  groups) 
in  the  face  of  a-priori  unknown  trait  inter-individual  variability;  b)  performance  prediction  for 
individuals  in  the  face  of  uncertain  initial  states;  and  c)  quantification  of  prediction  accuracy. 


Final  Report 


PI:  Van  Dongen 


23 


FA9550-06- 1-0055 


Individualized  Biomathematical  Modeling  of  Fatigue  and  Performanee 


The  Bayesian  foreeasting  proeedure  as  implemented  in  the  two-proeess  model  possesses  broad 
generalizability,  in  that  it  ean  be  used  to  prediet  waking  performanee  in  any  seenario  and  in  any 
population  for  whieh  the  two-proeess  model  proper  is  valid.  Thus,  the  proeedure  should  work  in 
total  sleep  deprivation,  aeute  sleep  restrietion,  aeute  sleep  displaeement,  and  nap  sleep  seenarios 
(Aehermann,  2004).  Furthermore,  besides  healthy  adults,  it  may  work  in  other  populations  sueh 
as  adoleseents  (Carskadon  et  ah,  2004),  people  with  depression  (Borbely,  1987),  and  patients 
with  seasonal  affeetive  disorder  (Koorengevel  et  ah,  2002).  Although  it  is  important  to  establish 
a  population  model  for  the  target  population,  it  is  not  neeessary  to  assess  the  population  model 
under  the  same  eireumstanees  as  those  for  whieh  the  Bayesian  foreeasting  will  be  used.  For 
example,  a  population  model  established  in  a  nap  sleep  seenario  should  be  usable  as  a  basis  for 
Bayesian  foreeasting  in  a  sleep  displaeement  seenario.  The  total  sleep  deprivation  seenario 
eonsidered  in  this  report  does  not  yet  offer  full  generalizability,  though,  beeause  the  data  set  does 
not  allow  estimation  of  the  rate  of  dissipation  for  the  homeostatie  proeess  during  sleep  (whieh 
eould  be  overeome  by  ineluding  performanee  data  from  the  reeovery  days  following  sleep 
deprivation).  Otherwise,  the  versatility  of  the  Bayesian  foreeasting  proeedure  is  not  bounded  by 
the  eireumstanees  assoeiated  with  the  population  model,  as  long  as  the  proeedure  is  applied  in 
aeeordanee  with  the  seope  of  the  underlying  mathematieal  model,  and  the  individuals  for  whieh 
performanee  is  being  predieted  are  part  of  the  same  population  as  the  sample  that  yielded  the 
population  model. 

The  validity  of  the  two-proeess  model  as  used  to  prediet  performanee  is  limited,  primarily,  to 
short-term  seenarios  with  aeute  sleep-related  interventions.  While  this  eovers  a  wide  range  of 
operationally  relevant  seenarios,  several  eommon  situations  are  outside  the  seope  of  the  two- 
proeess  model,  sueh  as  ehronie  sleep  restrietion  (Van  Dongen  et  ah,  2003;  see  also  later  in  this 
report),  eireadian  phase  shifting  (Folkard  et  ah,  1999),  and  use  of  pharmaeologieal  fatigue 
eountermeasures  (Balkin  et  ah,  2004).  The  effeet  of  sleep  inertia  on  eognitive  performanee 
immediately  after  awakening  (Binges,  1990)  is  also  not  eaptured  by  the  two-proeess  model. 
Various  adjustments  have  been  eonsidered  to  overeome  these  limitations  (Aehermann  and 
Borbely,  1994;  Akerstedt  and  Folkard,  1997;  Avinash  et  ah,  2005).  Furthermore,  other  models 
have  been  developed  to  push  the  envelope  on  performanee  predietion  (Mallis  et  ah,  2004).  The 
Bayesian  foreeasting  proeedure  may  be  implemented  in  the  framework  of  sueh  alternative 
models  as  well,  following  the  same  general  approaeh  as  laid  out  in  this  report.  Most  eurrent 
mathematieal  models  of  performanee  have  more  parameters  than  the  two-proeess  model, 
however,  whieh  may  inerease  the  number  of  performanee  measurements  needed  to  obtain 
reliable  subjeet-speeifie  parameter  estimates  and  may  also  inerease  the  size  of  the  95% 
eonfidenee  intervals.  Even  so,  with  Bayesian  foreeasting,  any  available  performanee  model  may 
be  utilized  to  make  performanee  predietions  for  individuals  in  the  faee  of  unknown  traits  and 
uneertain  states. 

This  work  built  on  the  work  by  Olofsen  et  al.  (2004),  in  whieh  Bayesian  foreeasting  was  already 
applied  to  optimize  subjeet-speeifie  trait  parameters.  The  present  work  extends  this  effort  by  for 
the  first  time  ineluding  initial  state  parameters  in  the  parameter  optimization  proeess.  Initial  state 
parameters  ean  be  treated  as  trait  parameters  in  the  eontext  of  Bayesian  foreeasting  if  they 
represent  enduring  eonditions  (i.e.,  if  their  values  may  be  assumed  stable  over  the  time  period  for 
whieh  predietions  are  made).  However,  for  initial  state  parameters,  unlike  trait  parameters,  the 
optimization  proeess  does  not  benefit  from  prior  information  eontained  in  the  population  model. 
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Moreover,  if  predietions  are  needed  for  individuals  who  were  subjeeted  to  Bayesian  foreeasting 
before,  then  the  previously  optimized  values  of  the  individuals’  trait  parameters  may  be  reused  to 
obtain  more  aeeurate  predietions  with  fewer  data  points  (see  Fig.  7) — ^but  this  Bayesian  property 
does  not  transfer  to  the  initial  state  parameters.  Improved  prior  information  about  the  initial  state 
parameters  may  be  aequired  by  other  means,  though.  For  instanee,  aetigraphy  eould  be  used  to 
traek  sleep  history,  and  eould  yield  probability  estimates  for  the  initial  homeostatie  state  ^  in  lieu 
of  the  assumed  uniform  distribution  in  Eq.  (14). 

The  assumption  of  enduring  initial  states  implies  that  the  use  of  the  Bayesian  foreeasting 
proeedure  deseribed  here  is  restrieted  to  seenarios  in  whieh  there  are  no  unexpeeted  ehanges  in 
initial  states — no  homeostatie  diseontinuities  (e.g.,  due  to  unreported  naps)  and  no  eireadian 
phase  shifts  (e.g.,  due  to  exposure  to  bright  light).  Considerable  work  has  been  done  to  derive 
equations  for  the  modeling  of  eireadian  phase  ehanges  (and  even  temporary  deviations  from  the 
limit  eyele  proeess  determining  eireadian  amplitude)  (e.g.,  Kronauer  et  ah,  1998;  St.  Hilaire  et 
ah,  2007).  Ineorporation  of  sueh  equations  may  allow  substitution  of  the  initial  state  parameter 
for  eireadian  phase  angle  by  a  few  trait  parameters,  thereby  lifting  the  assumption  of  enduring 
eireadian  phase  angle  in  the  present  work.  Other  approaehes  to  maintaining  performanee 
predietion  aeeuraey  under  eonditions  involving  dynamie  eireadian  phase  ehanges  ean  be 
envisioned  as  well.  One  sueh  approaeh  eould  entail  the  development  of  proeedures  relying  on 
on-line  measurements  for  estimating  eireadian  phase. 

Implementation  of  the  Bayesian  foreeasting  proeedure  does  not  prohibit  performanee  predietion 
in  the  absenee  of  any  subjeot-speoifie  data,  but  the  underlying  (group-average)  mathematieal 
model  is  only  outperformed  when  at  least  a  few  performanee  measurements  are  available  for  the 
individual  at  hand.  However,  in  operational  environments,  it  may  not  be  possible  or  praetieal  to 
interrupt  the  ongoing  tasks  in  order  to  administer  performanee  tests.  Automatieally  measured 
embedded  performanee  measures,  sueh  as  lane  deviation  to  traek  driver  performanee  (Gillberg  et 
ah,  1996),  may  offer  a  solution  to  this  problem.  An  additional  advantage  of  using  embedded 
performanee  measures  is  that  they  may  be  direetly  relevant  to  the  demands  of  the  operational 
setting.  However,  embedded  performanee  measures  must  be  sensitive  to  the  underlying 
neurobiology  in  order  to  be  useful,  and  must  not  be  overly  influeneed  by  other  faetors  (e.g., 
learning,  performanee  strategy,  environmental  distraetions)  that  ean  mask  the  influenee  of  sleep 
homeostasis  and  eireadian  rhythmieity  on  performanee  eapability.  Note  also  that  the  same 
performanee  measure  should  be  used  for  assessing  the  population  model  as  for  applying  the 
Bayesian  foreeasting  proeedure,  beeause  inter-individual  differenees  in  vulnerability  to  sleep  loss 
appear  to  be  dependent  on  the  type  of  performanee  being  measured  (Van  Dongen  et  ah,  2004a). 

We  reeently  published  our  work  on  the  Bayesian  foreeasting  proeedure  in  the  peer-reviewed 
literature  (Van  Dongen  et  ah,  2007a).  Sinee  then,  an  alternative  approaeh  for  individualized 
performanee  predietion  has  been  published  (Rajaraman  et  ah,  2008).  It  involves  transformation 
of  the  individualized  equations  of  the  two-proeess  model  into  a  set  of  linear  optimization 
problems,  whieh  are  solved  with  the  least-squares  method  in  order  to  find  estimates  for  the 
subjeet-speeifie  model  parameters. 

We  believe  that  the  Rajaraman  et  al.  (2008)  paper  eontains  a  number  of  important  inaoeuraeies. 
First,  the  Bayesian  foreeasting  methodology  is  eritiqued,  but  random  effeets  are  mixed  up  with 
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mfra-individual  variability;  prediction  horizon  limitations  are  mentioned  that  do  not  exist  (see 
also  Reifman  et  ah,  2007,  and  Van  Dongen  et  ah,  2007b);  multimodal  distributions  are  wrongly 
asserted  to  cause  convergence  problems;  and  the  computational  cost  of  our  numerical 
implementation  (see  above)  is  confused  with  the  fundamental  computational  expense  of 
Bayesian  forecasting  (which  can  be  shown  to  be  merely  of  order  V^;  see  Smith  et  ah,  in  press). 
Second,  the  two-process  model  proper  is  discredited  as  a  basis  for  performance  prediction  in 
total  sleep  deprivation  (Rajaraman  et  ah,  2008),  but  this  conclusion  is  based  on  a  critical  mistake 
in  the  processing  of  the  circadian  phase  parameter. 

These  erroneous  criticisms  of  the  work  of  others  notwithstanding,  there  is  no  a-priori  reason  to 
believe  that  the  Bayesian  forecasting  procedure  couldn’t  be  improved.  Even  so,  it  is  unclear  what 
the  advantage  of  the  Rajaraman  et  al.  (2008)  approach  would  be.  The  approach  requires 
performance  data  to  be  available  at  regular  time  intervals,  and  breaks  down  when  data  are 
missing.  In  addition,  parameter  convergence  is  much  slower  than  in  the  Bayesian  forecasting 
procedure.  Because  of  the  effort  involved  in  linearizing  the  model  equations,  the  Rajaraman  et  al. 
(2008)  approach  cannot  readily  be  applied  to  other  fatigue  and  performance  models. 

Linearization  also  prohibits  accurate  estimation  of  confidence  intervals. 

Rajaraman  et  al.  (2008)  claim  that  their  approach  does  not  require  in-advance  assessment  of  a 
population  model  to  individualize  performance  predictions  (in  fact,  even  if  a  population  model  is 
available,  the  approach  cannot  take  advantage  of  it).  However,  this  feature  comes  at  the  cost  of 
considerably  greater  need  for  performance  measurements  from  the  individual  at  hand — so  much 
so,  that  the  Bayesian  forecasting  procedure  can  as  well  be  used  effectively  without  a  population 
model  if  that  many  data  points  are  available.  Further,  the  Rajaraman  et  al.  (2008)  approach  is 
claimed  to  yield  a  unique  solution  for  the  parameter  optimization  problem,  even  if  the  pdf  for  the 
multidimensional  parameter  space  is  multimodal.  However,  application  of  the  least-squares 
method  to  multimodal  pdfs  may  yield  parameter  values  that,  while  representative  of  the 
statistical  mean,  do  not  themselves  have  a  high  likelihood  (e.g.,  Sivia,  1996).  The  usefulness  of 
predicting  performance  for  an  individual  on  the  basis  of  a  parameter  solution  that  does  not  have  a 
high  likelihood  is  questionable.  The  Bayesian  forecasting  procedure,  on  the  other  hand,  yields 
the  parameter  set  that  is  most  likely  for  the  individual  at  hand  (which  is  also  a  unique  solution), 
thereby  generating  the  most  probable  individualized  performance  predictions.  Furthermore,  if 
multimodality  of  pdfs  is  indeed  an  issue  in  practice,  then  it  is  straightforward  in  Bayesian 
forecasting  to  capture  any  ensuing  multimodality  in  the  performance  predictions. 

Regardless  of  ongoing  and  future  efforts  to  improve  the  present  methodology  (e.g.,  through 
application  of  predictive  covariates;  see  Olofsen  et  ah,  2004),  we  believe  that  the  Bayesian 
forecasting  procedure  as  presented  in  this  report  is  powerful  and  robust  enough  to  be  considered 
for  validation  in  selected  operational  settings.  Such  a  validation  should  begin  with  establishing 
population  models  for  these  operational  settings.  This  is  important  because  the  distribution  of  the 
trait  parameters  may  be  different  depending  on  the  population  involved,  and  the  error  variance 
(i.e.,  the  estimate  for  a  )  may  vary  from  one  setting  to  another.  Once  demonstrated  to  be  effective 
in  the  field,  the  Bayesian  forecasting  procedure  can  be  a  key  component  of  a  reliable  and 
efficient  sleep/wake-based  fatigue  management  tool — to  predict  cognitive  performance 
impairment,  and  possibly  even  accident  risk  (Ingre  et  ah,  2006),  at  the  level  of  individuals. 
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NEW  MATHEMATICAL  MODEL  FOR  THE  SLEEPA¥AKE  HOMEOSTATIC 
REGULATION  OF  FATIGUE  AND  PERFORMANCE 

Introduction 

Sleep  deprivation  and  eireadian  misalignment  eause  a  wide  range  of  eognitive  performanee 
defieits  (Dinges  and  Kribbs,  1991;  Banks  and  Dinges,  2007).  Various  mathematieal  models  of 
fatigue  and  performanee  have  been  developed  to  prediet  sueh  performanee  impairment  (Mallis  et 
al.,  2004).  However,  seientifie  progress  in  this  area  has  been  limited  by  diffieulties  predieting 
performanee  under  ehronie  eonditions  of  partial  sleep  loss  (Van  Dongen,  2004). 

Most  of  the  available  fatigue  and  performanee  models  are  based  on  the  seminal  two-proeess 
model  of  sleep  regulation  (Borbely,  1982;  Daan  et  al.,  1984).  This  model  posits  that  sleep  and 
wakefulness  are  governed  by  two  primary  biologieal  meehanisms;  a  homeostatie  proeess  that 
builds  pressure  for  sleep  during  wakefulness  and  dissipates  this  pressure  during  sleep  (Borbely 
and  Aehermann,  1999),  and  a  eireadian  proeess  that  modulates  sleep  pressure  as  a  function  of 
time  of  day  (Edgar  et  al.,  1993).  The  two-process  model  has  been  successful  in  predicting 
various  aspects  of  sleep  and  of  waking  cognitive  functions  across  a  range  of  sleep  and  sleep 
deprivation  paradigms  (Borbely  and  Aehermann,  1999;  Aehermann,  2004).  For  instance,  it  was 
shown  that  waking  cognitive  functions  could — in  many  instances — be  predicted  by  the 
arithmetic  difference  between  the  homeostatic  pressure  for  sleep  and  the  circadian  pressure  for 
wakefulness  (Aehermann  and  Borbely,  1994). 

Extending  the  two-process  model  from  its  original  focus  on  sleep  (Borbely,  1982)  to  include 
predictions  of  waking  functions  has  been  a  goal  for  some  time  (Borbely  and  Aehermann,  1999; 
Dinges  and  Aehermann,  1999).  However,  efforts  to  achieve  this  goal  have  not  been  universally 
successful.  Several  studies  have  shown  that  chronic  sleep  restriction  leads  to  cumulative 
increases,  progressing  over  days  for  a  week  or  more,  in  sleep  propensity  and  cognitive 
impairment  (Carskadon  and  Dement,  1981;  Dinges  et  ah,  1997;  Belenky  et  al.,  2003;  Van 
Dongen  et  ah,  2003) — see  Fig.  8a.  The  two-process  model  does  not  accurately  capture  these 
increasing  deficits,  predicting  instead  a  stabilization  of  waking  cognitive  functions  across  days 
after  just  a  few  days  of  chronic  sleep  loss  (Van  Dongen  et  al.,  2003) — see  Fig.  8b.  Other  fatigue 
and  performance  models  have  similarly  failed  to  predict  the  cumulative  effects  of  chronic  sleep 
restriction  (Van  Dongen,  2004). 

Van  Dongen  et  al.  (2003)  proposed  a  different  model,  shifting  the  emphasis  from  sleep  loss  to 
cumulative  wake  extension  or  “excess  wakefulness”.  This  subtle  conceptual  difference  provided 
a  parsimonious  explanation  for  the  effects  on  waking  functions  of  both  acute  total  sleep 
deprivation  and  chronic  partial  sleep  deprivation  (Van  Dongen  et  ah,  2003;  Van  Dongen  and 
Dinges,  2003b).  The  excess  wakefulness  model  has  theoretical  significance,  but  it  is  not  useful 
for  computational  predictions  of  cognitive  impairment,  because  it  does  not  explicitly  state  how 
recovery  from  the  effects  of  prior  sleep  loss  would  be  achieved. 
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(d) 


Figure  8:  Cognitive  performanee  observations 
and  predietions  by  different  models.  A  total  of  48 
healthy  young  adults  were  subjeeted  to  one  of  four 
laboratory  sleep  deprivation  protoeols  (Van 
Dongen  et  al.,  2003).  Eaeh  protoeol  began  with 
several  baseline  days  involving  8h  time  in  bed 
(TIB),  the  last  of  whieh  is  labeled  here  as  day  0. 
Subsequently,  13  subjeets  were  kept  awake  (Oh 
TIB)  for  3  additional  24h  days  (left  panels).  The 
other  subjeets  underwent  various  doses  of  sleep 
restrietion  for  14  eonseeutive  days,  followed  by  2 
days  with  reeovery  sleep  at  8h  TIB  (right  panels). 
The  sleep  restrietion  dose  was  4h  TIB  per  day  for 
13  subjeets  (red);  6h  TIB  per  day  for  another  13 
subjeets  (yellow);  and  8h  TIB  per  day  for  the 
remaining  9  subjeets  (green).  Awakening  was 
scheduled  at  07:30  each  day.  Performance  was 
tested  every  2h  during  scheduled  wakefulness 
using  the  PVT,  for  which  the  number  of  lapses 
(RT  >  500ms)  was  recorded. 

(a)  Observed  performance  (PVT  lapses)  for  each 
test  bout  (dots  represent  group  averages).  The  first 
two  test  bouts  of  each  waking  period  are  omitted 
in  order  to  avoid  confounds  from  sleep  inertia. 
Gray  bars  indicate  scheduled  sleep  periods. 

(b)  Performance  predictions  according  to  the 
original  two-process  model  (Borbely  and 
Achermann,  1999),  linearly  scaled  to  the  data. 
Boxes  represent  performance  predictions  at  wake 
onset.  Thin  curves  represent  predictions  within 
days,  but  the  focus  here  is  on  changes  across  days 
(dashed  lines).  Note  the  rapid  stabilization  across 
days  predicted  to  occur  in  the  chronic  sleep 
restriction  conditions  (right  panel),  which  does  not 
match  the  observations,  (c)  Performance 
predictions  according  to  the  extended  two-process 
model  (Avinash  et  al.,  2005),  linearly  scaled  to  the 
data.  Note  the  under-prediction  of  performance 
impairment  in  the  total  sleep  deprivation  condition 
(left  panel)  and  the  over-prediction  of  the 
impairment  build-up  across  days  in  the  4h  TIB 
condition  (right  panel),  relative  to  the  actual  data, 
(d)  Performance  predictions  according  to  the  new 
model  defined  by  Eqs.  (40)  and  (45).  Note  the 
improved  fit  to  the  experimental  observations 
across  days  for  total  sleep  deprivation  (left  panel), 
as  well  as  for  the  4h  TIB  condition  (right  panel). 
Performance  impairment  in  the  6h  TIB  and  8h 
TIB  conditions  (right  panel)  is  under-predicted. 
However,  the  average  impairment  levels  observed 
for  these  conditions  are  inflated  due  to  a  few 
outliers  (Van  Dongen  et  al.,  2003). 


utions  were  introduced  by  Hursh  et  al.  (2004)  and  by  Johnson  et  al.  (2004),  who 
m  additional  regulatory  process  modulating  their  versions  of  the  homeostatic 
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process,  in  order  to  aeeount  for  the  cumulative  effects  of  chronic  sleep  restrietion.  Based  on  the 
approach  proposed  by  Johnson  et  al.  (2004),  Avinash  et  al.  (2005)  then  extended  the  original 
two-proeess  model,  as  part  of  the  present  project.  The  objective  of  this  effort  was  to  eapture  the 
effeets  of  ehronie  sleep  restriction  on  waking  cognitive  performanee  (Van  Dongen  et  ah,  2003), 
while  retaining  the  sueeesses  of  the  original  two-proeess  model  in  predieting  other  aspeets  of 
waking  funetions  and  sleep  (Achermann,  2004).  The  Avinash  et  al.  (2005)  approach,  which  was 
seminal  for  further  work  in  this  project,  can  be  summarized  as  follows. 


The  homeostatic  process  of  the  original  two-proeess  model  is  typically  represented  as  a  pair  of 
difference  equations  (Borbely  and  Aehermann,  1999); 

-Af 


< 

1 

1  ' 

II 

during  wake. 

(19a) 

St=e^^S,_,, 

during  sleep. 

(19b) 

Here  S  is  the  homeostatic  sleep  pressure  as  a  function  of  time  t;  At  is  the  time  step;  and  Tr  >  0  and 
Td  >  0  are  time  eonstants  for  the  rise  and  deeay  of  the  homeostatie  proeess  during  wakefulness 
and  sleep,  respectively.  The  reason  the  two-proeess  model  prediets  excessively  rapid 
stabilization  of  performance  aeross  days  of  sleep  restriction  is  related  to  the  asymptotie 
properties  of  Eqs.  (19).  Speeifically,  the  wake  equation  tends  to  a  steady  state  represented  by  an 
upper  asymptote  U=  while  the  sleep  equation  tends  to  a  steady  state  represented  by  a  lower 


asymptote  V=  0.  This  asymptotic  behavior  can  be  demonstrated  by  rewriting  Eqs.  (19); 

-At 

St -U,=  )e during  wake,  (20a) 

-At 

S,-V,=  )e during  sleep.  (20b) 

The  extension  of  the  two-proeess  model  by  Avinash  et  al.  (2005)  involved  modulating  the 
homeostatic  process  through  manipulation  of  the  asymptotes  U  and  V  in  Eqs.  (20),  as  follows; 

U,  =  -I-  /ii^At  during  wake,  (21a) 

-At 

U,  =  U,_^,  +  {\-  )(1  -  e  ^^  )  during  sleep,  (21b) 

Vt=Ut-h  (21c) 


Here  jUr>0  represents  the  slope  of  a  linear  rise  of  the  asymptotes  during  wakefulness,  and  /ra  >  0 
represents  the  time  constant  of  an  exponential  decay  of  the  asymptotes  during  sleep. 

The  model  proposed  by  Avinash  et  al.  (2005)  performed  better  at  eapturing  the  eumulative 
deficits  in  cognitive  performanee  aeross  days  as  indueed  by  ehronie  sleep  restriction,  but  at  the 
eost  of  redueed  aeeuraey  in  deseribing  the  magnitude  of  the  effeets  across  days  of  acute  total 
sleep  deprivation — see  Eig.  8c.  However,  it  can  be  shown  that  the  model  of  Eqs.  (21)  belongs  to 
a  mueh  broader  class  of  homeostatic  models  based  on  the  same  principles,  which  offer  further 
improvements  in  predicting  performance  impairment  aeross  days  of  sleep  loss. 
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New  Class  of  Models  Formulated  in  Terms  of  Coupled  Non-Homogeneous  First-Order 
Ordinary  Differential  Equations 


Beginning  with  the  original  two-proeess  model  (Aehermann  and  Borbely,  1994),  we  ean  write 
model  equations  for  eognitive  performanee  as: 

Pni^)  =  %(0  - c(t)  for  te  [tn,  tn  +  Wn\  (i.c.,  during  wake),  (22a) 

q„{t)  =  s^t)  -  c{t)  for  te  [tn  +  Wn,  tn  +  Tn]  (i.e.,  during  sleep).  (22b) 

The  variables  w„  and  Sn  denote  the  homeostatie  pressure  during  wakefulness  and  sleep, 
respeetively,  in  the  wake/sleep  eyele  (i.e.,  day),  where  n  =  0,  1,  ...  The  funetion  c{t)  is  the 
original  eireadian  proeess  (see  Borbely  and  Aehermann,  1999).  Further,  tn  denotes  the  time  of  the 


beginning  of  the  n*  wake/sleep  eyele,  Tn  is  the  total  duration  of  the  eyele  (sueh  that  t„+i  =  4  + 
Tn),  and  Wn  is  the  duration  of  wakefulness  in  the  n*  eyele.  We  require  that  0<  Wn<  Tn,  where 
Wn  =  Tn  corresponds  to  total  sleep  deprivation.  Finally, and  qn  are  the  predictions  for 
performance  during  wakefulness  and  sleep,  respectively,  in  the  wake/sleep  cycle.  The 
predictions  during  sleep  are  notional;  they  are  included  strictly  for  continuity  between 
consecutive  wake/sleep  cycles.  Here  pn  and  qn  are  coupled  as  follows: 

Pnitn+WJ  =  qStn+WJ,  (23a) 

(lnitn+TJ  =  (23b) 


th 


The  homeostatic  process  of  Eqs.  (19)  may  be  written  in  the  form  of  a  system  of  first-order 
ordinary  differential  equations  (ODEs): 

^  =  — (%  - 1)  for  [tn,  tn  +  Wn],  (24a) 

at 


ds  —  1 

—p-  = - i0Xt^[tn+Wn,tn+Tn].  (24b) 

at 

Note  that  and  Sn  are  still  functions  of  time  t,  but  to  reduce  clutter  in  later  differential  equations 
this  is  no  longer  indicated  explicitly.  Erom  Eqs.  (24)  it  follows  that  Eqs.  (22)  can  also  be  written 
as  a  system  of  first-order  ODEs: 


^ AO 

at 

at 


for  te  [tn,  tn  +  Wn], 


for  te  [4  +  Wn,  T  +  Tn], 


(25a) 


(25b) 


where  pn  and  qn  are  again  coupled  as  per  Eqs.  (23).  The  non-homogeneities  y5(t)  and  y{t)  represent 
the  circadian  process,  and  may  be  generalized  to  include  other  non-homeostatic  influences  on 
performance. 


The  system  of  Eqs.  (25)  is  an  exact  representation  of  the  original  two-process  model  (Borbely 
and  Aehermann,  1999).  In  the  same  manner,  the  extended  two-process  model  of  Avinash  et  al. 
(2005)  can  be  written  as  a  system  of  coupled  non-homogeneous  first-order  ODEs: 
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-l/r^  l/r^  p„  ^  A(0 

0  0  Jl“J  lA(0 

-l/Td  (l/rd-l///d)Tg„ 

0 


for  [tn,  tn  +  Wn\, 


for  fe  [4  +  tn  +  I’m]. 


(26a) 


(26b) 


Here  and  v„  are  the  levels  of  the  upper  and  lower  asymptotes,  respeetively,  in  the  n 
wake/sleep  eyele.  The  non-homogeneities  P\{t)  and  y\{t)  represent  the  eireadian  proeess,  and  may 
again  be  generalized  to  inelude  other  non-homeostatie  influenees  on  performanee.  Likewise, 

P2{i)  and  y2{i)  represent  any  eireadian  or  other  non-homeostatie  effeets  there  might  be  on  the 
levels  of  the  upper  and  lower  asymptotes.  Note  that  in  this  notation,  Pi{t)  and  P2{t)  have  absorbed 
the  parameter  (i.e.,  the  slope  of  the  linear  rise  of  the  upper  asymptote  during  wakefulness). 
Analogous  to  Eqs.  (23),  Eqs.  (26)  are  eoupled  as  follows: 

[p  (t  +W)~\  q  (t  +W)  1 

V  n  n  n’  \ 

/  ,  -rrr  \  /  ,  .  XTr  \  ^  k  / 


p  (t  +W)  q  (t  +W) 

V  n  n  n’  /n 

w„(L+lEJ  ~  v(t+WJ  +  S’ 

where  <5  >  0  is  the  distanee  between  the  two  asymptotes.  Eor  the  extended  two-proeess  model, 
(5=1  (Avinash  et  ah,  2005). 


(27b) 


When  we  write  Eqs.  (26)  in  generalized  form,  it  beeomes  elear  that  there  is  an  asymmetry  in  the 
extended  two-proeess  model  of  Avinash  et  al.  (2005): 


Pn~\\ccn  CCy2lPn~\\Pxi^) 

yn\  [0  ojL^J  lA(0_ 


for  te  [tn,  tn  +  Wn\, 


(28a) 


kii  T/iCO 

_\\  [0  ^22JL^J  L/2(0_ 


for  te[tn+  Wn,  tn  +  7),]. 


(28b) 


Namely,  Eq.  (28b)  for  sleep  has  one  more  parameter  than  Eq.  (28a)  for  wakefulness.  Adding  the 
eorresponding  eoeffieient  a22  in  Eq.  (28a)  generates  a  useful  new  model,  as  shown  later  in  this 
report.  Moreover,  both  equations  have  room  for  another  parameter  in  the  2  by  2  eoeffieient 
matriees  (i.e.,  a2i  and  (T21,  respeetively). 


We  define  our  new  elass  of  models,  formulated  in  terms  of  eoupled  non-homogeneous  first-order 
ODEs,  by  the  following  generalized  equations  (whieh  ineorporate  the  original  and  extended  two- 
proeess  models): 


r«ii  a,^Jp^\p,{t) 

[aji  «22JlwJ  lA(0_ 


for  te  [tn,  tn  +  Wn\, 


(29a) 


_\\  1^21  ^22Jl^J  L/2(0_ 


for  te[tn+  Wn,  tn  +  Tn\. 


(29b) 


The  eoupling  of  these  equations  is  given  by  Eqs.  (27).  Of  the  non-homogeneities  P\{t),  P2{t),  y\{t) 
and  72(0  we  require  that  they  are  bounded,  oseillatory  funetions.  They  eo-determine  the  profiles 
of  performanee  ehanges  within  wake/sleep  eyeles,  in  part  through  the  eireadian  proeess,  but  this 
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is  beyond  the  foeus  of  the  present  work.  The  a  and  a  eoeffieient  matriees  are  of  primary  interest 
here,  as  they  determine  the  dynamie  behavior  of  the  system  across  wake/sleep  eyeles. 


For  eonstant  values  of  the  a  and  a  eoeffieients,  the  general  solution  of  the  ODE  system  of  Eqs. 
(29)  is  of  the  form  (Derriek  and  Grossman,  1997): 


Pnit) 

w„(0 

(Init) 


=  ¥n(t)¥n  iK) 


-F 


PniK) 

uSK) 

(ln(tn+W„) 

K(^„+K) 


Plis) 

P2{S)_ 


ds. 


i' F) 


/liP 

MP. 


ds. 


(30a) 

(30b) 


where  i//„(t)  and  (p„{t)  are  the  respeetive  fundamental  solutions  of  the  homogeneous  parts  of  Eqs. 
(29).  These  fundamental  solutions  depend  on  the  eigenvalues  2,  and  the  eorresponding 
eigenveetors  [kn  ;  ka]  of  the  a  and  a  eoeffieient  matriees.  The  eigenvalues  and  eigenveetors  of 
the  a  eoeffieient  matrix  are  found  by  solving: 


det 


VL 


®11 
a. 


'-21 


a  12 
0,22  ~ 


=  0; 


1 

1 _ 

a^2 

- 1 

1 

0 

1 

K> 

CC22  ~  ^  i 

1 - 

to 

L  _ 

1 

0 

_ 1 

(31a) 

(31b) 


The  proeess  is  analogous  for  the  a  eoeffieient  matrix. 


The  fundamental  solution  y/„{t)  depends  on  the  real  and  distinet  eigenvalues  2i  and  h  found  by 
solving  Eqs.  (31);  and  the  fundamental  solution  (p„{t)  depends  on  the  likewise  derived  real  and 
distinet  eigenvalues  ^3  and24,  as  follows: 


¥nit)  = 


(Pn(t)  = 


k,,e 
k,2e 
k^^e 
k,2e 


k2,e 
^22^ 
k,,e 

^42^ 


2.-,t 


AaI 


(32a) 


(32b) 


Note  that  while  Eqs.  (32)  are  sensitive  to  shifting  of  the  origin  of  the  time  variable  t,  the 
funetions  y/n{t)  and  (p„{t)  end  up  being  used  only  in  produets  with  their  respeetive  inverses,  and 
these  so-ealled  prineipal  matrix  solutions  are  invariant  to  time  translation. 


Having  found  the  general  solution  of  the  ODE  system  of  Eqs.  (29),  differenee  equations  ean  be 
derived  for  the  predieted  level  of  performanee  at  the  onset  of  eaeh  wake  period  and  at  the  onset 
of  eaeh  sleep  period.  Although  these  predietions  for  wake  onset  do  not  aeeount  for  transient 
effeets  of  sleep  inertia  (e.g.,  Dinges,  1990),  and  the  predietions  for  sleep  onset  are  merely 
notional  (sinee  the  person  is  asleep),  they  eompletely  deseribe  the  model  behavior  aeross 
wake/sleep  eyeles.  They  therefore  serve  as  useful  anehor  points  to  examine  the  pattern  of 
eognitive  performanee  ehanges  aeross  days. 


Using  Eqs.  (27)  and  (30),  the  differenee  equations  for  performanee  at  wake  onset, /7„(4),  and  for 
performanee  at  sleep  onset,  q„{tn  +  Wn),  ean  be  shown  to  be  given  by: 
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Pn+\^K+\) 

.^n+l(^n+l) 

n+\  ^n+l) 


PniK) 

Unitn) 


+  F„, 


F„  = 


rn 

o' 

1 

=  (PniK  +  T„)(p:\t,  +  W„)y/St„  + 

n+\  '^^n+\)¥n\\iK+\)(PniK  +TJ(pJ{t„  +  Wj\ 

\ 

-(PniK+T„)(p;\t„+WJ 


qStn  +  K) 


+ 


r„C"  ^  ds  +  (pSt„  +  TJ(p-^\t„  +  WniK  +  ^ n)W^n 


PM) 

PM)_ 


=- 


rn 

o' 

lo 

1 

H+i  (^rt-Fi  +  ^«+i)^^»!i(4+i) 


-f 


(33a) 

(33b) 

(33c) 

ds. 

(33d) 


r'»+i+(r„+i  ,  .  1  ,  . 

PM) 

1  '^’^n  1 

•’'n+l 

(PniK  +  MMn  M 

rM) 

72  (^)_ 


Changes  in  cognitive  performance  across  wake/sleep  cycles  depends  entirely  on  this  system  of 
difference  equations  for  performance  at  the  onsets  of  wakefulness  and  sleep. 

Of  particular  interest  is  whether  the  pattern  of  changes  in  cognitive  performance  across 
wake/sleep  cycles  can  display  a  steady  state  or  “fixed  point” — that  is,  whether  the  performance 
profile  within  days  can  be  found  to  repeat  itself  across  days  or  across  clusters  of  days  when  a 
particular  wake/sleep  schedule  is  maintained.  This  condition  of  fixed  wake  duration  W  and  fixed 
wake/sleep  cycle  duration  T  is  described  by: 

P„„(‘.hJ  =  P,(‘„),  (34a) 

9..,. (34b) 
where  m  =  1,  2,  ...  is  the  number  of  wake/sleep  cycles  after  which  the  performance  pattern 
repeats  itself  If  the  oscillation  period  r  of  the  non-homogeneities  PM,  Piit),  y\{t)  and  yiit)  equals 
the  wake/sleep  cycle  duration  T,  as  is  the  case  under  conditions  of  circadian  entrainment,  then 
the  fixed  point  performance  pattern  would  be  expected  to  repeat  itself  every  day  (i.e.,  m  =  1).  If 
xi^T,  then  a  beat  phenomenon  could  occur  in  which  the  performance  pattern  repeats  itself  every 
m  days.  Forced  desynchrony  protocols  (e.g.,  Dijk  and  Czeisler,  1994)  are  based  on  this 
supposition. 

Indeed,  for  fixed  wake  duration  W  and  fixed  wake/sleep  cycle  duration  T,  and  assuming  that  the 
non-homogeneities  oscillate  with  period  x=  T,  Eqs.  (32),  (33c)  and  (33d)  may  become  repetitive 
across  wake/sleep  cycles  n.  Fixed  points  \p{tn)  m(4)]  and  [q{tn  +  JV)  v{tn  +  W)]  can  be  derived  by 
solving  Eqs.  (33),  which  results  in: 


p(0 

r 

“1 

o' 

V 

0 

1 

q{tn+W) 

/ 

'1 

v(t^+W) 

\ 

0 

-  (P(K  +  T)(P^\K  +  W)¥it„  +  W)y/-\tJ 


F, 


-y/{t^+W)y/-\t„)(p{t„+T)M{t^+W) 


G. 


(35  a) 
(35b) 


\ds. 
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Because  of  the  matrix  inversions  embedded  in  Eqs.  (35),  fixed  points  can  only  exist  if: 


det 


det 


rn 

0“ 

vLo 

1 

rn 

o' 

lo 

1 

-  (Pitn  +  T)(p^\t„  +  W)y/{t„  + 

-  y/{t^  +  +  T)(p-\t^  +  W) 


^  0,  and 


^0. 


Below,  we  examine  this  condition  for  a  specific  case  of  the  model  defined  by  Eqs.  (29). 


(36a) 

(36b) 


Provided  a  fixed  point  is  shown  to  exist,  the  question  arises  whether  it  is  stable,  that  is,  whether 
the  model  predictions  would  converge  to  this  fixed  point  for  a  repetitive  wake/sleep  schedule. 
We  can  say  that  the  model  is  asymptotically  stable  (for  m  =  1)  or  asymptotically  periodic  (for 
m>  \)  if: 


lim 


Pn+m^^n+m^  ■ 

P(K) 

_  ^n+m  ^  _ 

(37a) 


lim 

n—><x> 


(In+miK+m  +  ^) 

~q{K+W) 

_v(t„+W)_ 

(37b) 


even  if  the  starting  values  [po(to)  Mo(to)]  and  [^o(to)  vo(to)]  are  not  already  on  the  fixed  point. 
Because  Eqs.  (33)  are  linear  in  [p„(t„)  M„{tn)]  and  [qnitn  +  W)  v„{tn  +  W)],  the  stability  of  fixed 
points  is  determined  by  the  eigenvalues  of  the  following  matrices: 

=  (38a) 

+W)  =  +  W)w-\0(p{0(p-\K  +  W).  (38b) 


It  can  be  shown  (Kelly  and  Peterson,  2001)  that  fixed  points  are  asymptotically  stable  if  all 
eigenvalues  A,  of  the  system  of  Eqs.  (33),  whether  real  or  complex,  are  inside  the  unit  circle 
(i.e.,  |A,-|  <  1).  The  eigenvalues  are  found  by  solving  the  characteristic  equations: 


det 


'1 

oT 

0 

iJJ 

=  0, 


det 


0„(t„-FlE)-A, 


'1 

oT 

0 

iJJ 

=  0. 


(39a) 


(39b) 


Inspection  of  Eqs.  (38),  the  results  of  which  are  mirrored,  reveals  that  the  eigenvalues  derived 
from  Eq.  (39a)  are  identical  to  those  derived  from  Eq.  (39b).  Thus,  the  fixed  points  \p{tn)  u{tnj\ 
and  {q{tn  +  W)  v{tn  +  W)]  are  either  both  asymptotically  stable  (or  periodic),  or  both  unstable. 
We  now  examine  this  property  for  a  specific  version  of  the  model. 


A  Model  with  a  Bifurcation 


We  consider  a  particular  case  of  the  model  of  Eqs.  (29): 


Pn 

Ctlj  Ct^2 

Pn 

-1- 

u 

L  «  J 

0  a22 

u  ' 

_  n  _ 

for  te  [tn,  tn  +  Wn], 


(40a) 
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1 - 

(N 

b 

b 

1 _ _ _ 

(In 

-f 

hit) 

j’n_ 

0  0-22 

_^2(0_ 

for  t&[tn+  Wn,  tn  +  Tn~\, 


(40b) 


where  an  <  0  and  an  <  0,  and  where  an  o-ii  and  an  7^  on.  The  eoupling  of  these  equations  is 
given  by  Eqs.  (27).  As  before,  we  require  that  the  non-homogeneities  y5i(t),  y\{f)  and  >’2(0 

are  bounded,  oscillatory  functions. 


Per  Eqs.  (31),  the  (real  and  distinct)  eigenvalues  of  the  a  and  a  coefficient  matrices  are; 

/li  =  an  <  0;  =  0.22,  ^3  =  an  <  0;  and  /I4  =  a22.  Through  Eqs.  (32),  these  eigenvalues  determine 

the  existence  of  fixed  points  as  assessed  using  Eqs.  (36).  Linder  conditions  of  fixed  wake 
duration  W  and  fixed  wake/sleep  cycle  duration  T,  Eqs.  (36)  reduce  to  the  following  sole 
inequality;  (1  -  ^  0.  If  both  a  parameters  and  both  a  parameters 

are  negative,  this  inequality  is  satisfied  and  thus  fixed  points  exist  for  all  0  <  IE<  T  (both  for 
performance  at  wake  onset  and  for  performance  at  sleep  onset).  If  either  a22  >  0  or  022  >  0, 
however,  there  may  be  a  critical  amount  of  daily  wakefulness  Ifc,  with  0  <  ITc  <  T,  for  which  no 
fixed  point  exists; 

~  T.  (41) 

^22  ^  *^22 


To  assess  the  stability  of  the  fixed  points  when  they  do  exist,  we  solve  Eqs.  (39),  which  results  in 
the  following  eigenvalues; 

^42a) 

(42b) 

If  all  a  and  a  parameters  in  Eqs.  (42)  are  negative,  then  0  <  Ai  <  1  for  both  eigenvalues,  meaning 
that  the  fixed  points  (which  then  exist  for  all  0  <  IE<  J)  are  always  asymptotically  stable.  Since 
the  difference  equation  system  considered  here  is  linear,  this  stability  is  global  (i.e.,  the 
predictions  converge  to  the  fixed  point  regardless  of  initial  conditions). 
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Figure  9:  Dynamic  behavior  of  the  bifurcating  model  given 
by  Eqs.  (40).  The  figure  shows  performance  predictions 
(PVT  lapses  of  attention)  at  wake  onset  (boxes)  for  16  days 
(n  =  0,  1,  . . .,  15)  of  fixed  duration  T=  24h,  assuming  a 
constant  period  t  =  24h  for  the  non-homogeneities.  The  thin 
curves  represent  the  predictions  within  days  using  the  non¬ 
homogeneities  given  by  Eqs.  (45) — but  the  profile  of  changes 
across  days  (dashed  lines)  as  determined  by  the  a  and  a 
coefficient  matrices  is  of  primary  interest  here.  Each 
prediction  curve  corresponds  to  a  different  amount  of  daily 
wakefulness:  1F=  16h  (green),  1F=  18h  (yellow),  20h 
(red),  1F=  22h  (dark  gray),  and  24h  (i.e.,  total  sleep 
deprivation;  black).  Light  gray  areas  indicate  nocturnal  sleep 
periods.  In  this  illustration,  the  bifurcation  point  is  set  to 
occur  at  Wc  =  20h.  For  daily  wake  durations  below  the 
bifurcation  point  (green  and  yellow),  the  model  thus 


converges  to  an  asymptotically  stable  fixed  point,  that  is,  performance  impairment  ultimately  levels  off  For  daily 
wake  durations  beyond  the  bifurcation  point  (gray  and  black),  the  model  diverges  from  an  unstable  fixed  point, 
meaning  that  performance  impairment  tends  to  escalate.  At  exactly  the  bifurcation  point  W=Wc  (red),  there  is  no 
fixed  point,  resulting  in  an  asymptotically  linear  build-up  of  perfonnance  impairment  across  days. 
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If  an  (the  key  parameter  distinguishing  the  model  given  by  Eqs.  (40)  from  the  extended  two- 
proeess  model)  is  positive,  there  are  three  possibilities  for  A2.  In  order  of  inereasing  amount  of 
sleep  loss,  these  possibilities  are: 

•  For  W  <  IFc,  we  find  that  0  <  A2  <  1,  implying  globally  asymptotieally  stable  fixed  points; 

•  For  W=  Wc,  no  fixed  point  exists  (see  above); 

•  For  IF  >  IFc,  we  find  that  A2  >  1,  implying  that  the  fixed  points  are  unstable. 

Thus,  for  a22  >  0,  the  model  behavior  is  sueh  that  if  the  amount  of  wakefulness  IF  in  eaeh 
wake/sleep  eyele  exeeeds  a  eritieal  threshold  JVc,  the  model  flips  from  a  state  in  whieh 
performanee  predietions  eonverge  toward  an  asymptotieally  stable  fixed  point,  to  a  state  in  whieh 
performanee  predietions  diverge  away  from  an  unstable  fixed  point.  This  qualitative  ehange  in 
dynamie  behavior  eonstitutes  a  bifureation — see  Fig.  9. 


It  is  instruetive  to  study  the  model  behavior  when  daily  wakefulness  is  kept  eonstant  at  the 
bifureation  value:  JV=  Wc.  Here,  the  generalized  iterative  system  of  Eqs.  (33)  assumes  the 
following  speeifie  form: 
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The  solution  of  this  system  tends  to  a  straight  line  as  n  — >  go.  The  change  across  days  for 
performance  at  wake  onset  and  sleep  onset  is  defined,  respectively,  by  slopes  Mp  and  Mq. 
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where  F2  and  G2  are  the  second  element  of  vectors  F  and  G  in  Eqs.  (33).  From  Eqs.  (44)  it 
follows  that  the  slopes  of  change  across  days  are  not  necessarily  the  same  for  performance  at 
wake  onset  and  performance  at  sleep  onset. 


Model  Simulations 

To  compare  the  model  given  by  Eqs.  (40)  to  actual  performance  observations  under  conditions  of 
sleep  loss,  we  fit  it  to  group-average  data  of  performance  lapses  on  a  psychomotor  vigilance  test 
(PVT;  Binges  and  Powell,  1985;  Dorrian  et  ah,  2005)  from  a  study  of  healthy  young  adults 
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subjected  to  chronic  sleep  restriction  or  total  sleep  deprivation — with  W=  16h,  18h,  20h,  or  24h 
(Van  Dongen  et  ah,  2003).  These  data  are  shown  in  Fig.  8a. 


For  the  non-homogeneities,  we  make  use  of  the  circadian  process  c(t)  defined  by  Borbely  and 
Achermann  (1999),  applied  to  the  performance  predictions  pn  and  qn  (but  not  the  asymptotes 
and  v„): 


~A(0~ 

y  c{t-0)  +  p 

0 

/i(0 

y  c{t  -6)  +  p 

_^2(0_ 

0 

for  te  [tn,  tn  +  Wn\, 

for  te  [4  +  Wn,  t„  +  T„]. 


(45a) 

(45b) 


Here  y  and  p  are  parameters  scaling  the  circadian  process,  and  0  is  a  phase  parameter  shifting  it 
in  time.  For  the  initial  conditions  [po(to)  Mo(to)]  we  estimate  the  values  corresponding  to  the  fixed 
point  atW=  16h,  which  characterizes  the  baseline  condition  in  the  study.  Further,  to  =  7.5h  (i.e., 
07:30),  and  T  and  x  are  fixed  at  24h. 


Using  least-squares  regression,  we  find  the  following  parameter  estimates: 
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(46) 


The  resulting  PVT  performance  predictions  are  shown  in  Fig.  8d,  and  the  predictions  for  the  total 
sleep  deprivation  condition  (JV=  24h)  are  explored  in  more  detail  in  Fig.  10.  With  the  parameter 
estimates  of  Eqs.  (46),  the  model  explains  72.4%  of  the  variance  in  the  group-average  data  of 
Fig.  8a.  It  fits  substantially  better  to  the  data  than  the  original  two-process  model  (Fig.  8b, 
explained  variance  22.6%)  and  the  extended  two-process  model  (Fig.  8c,  explained  variance 
38.4%). 


Evaluation  of  Eq.  (41)  given  the  parameter  estimates  in  Eqs.  (46)  indicates  that  there  must  be  a 
bifurcation  at  fVc  =  20.2h.  That  is,  the  model  should  flip  from  a  state  of  convergence  to  a  state  of 
divergence  when  daily  sleep  is  reduced  to  less  than  3.8h. 

This  property  can  be  verified  by  comparing  model  predictions  to  the  group-average  observations 
of  PVT  performance  in  another  study  of  chronic  sleep  restriction,  with  JV=  15h,  17h,  19h  or  21h 
(Belenky  et  ah,  2003).  These  data  are  shown  in  Pig.  11a.  We  use  the  non-homogeneities  defined 
in  Eqs.  (45)  again,  set  to  =  7. Oh  (i.e.,  07:00)  in  accordance  with  the  study  design,  and  fix  all 
model  parameters  at  their  previously  estimated  values  given  in  Eqs.  (46). 
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Figure  10:  Examination  of  the  performanee  predietions 
under  eonditions  of  total  sleep  deprivation.  The  new  model 
defined  by  Eqs.  (40)  and  (45)  with  the  parameter  estimates 
given  by  Eqs.  (46)  has  a  bifureation  at  =  20. 2h,  implying 

that  predietions  for  performanee  in  the  total  sleep  deprivation 
eondition  (i.e.,  If  =  24h  >  JVc)  of  Fig.  8a  (top  left  panel) 
should  exhibit  diverging  (i.e.,  esealating)  performanee 
impairment  aeross  days.  However,  the  aetual  predietions 
displayed  in  Fig.  8d  (bottom  left  panel)  would  seem  to 
suggest  a  eonverging  pattern.  This  ean  be  explained  by 
simultaneously  eonsidering  the  performanee  predietions  p„ 
(blaek  dashed  eurve),  the  fixed  point  p  (dotted  horizontal 
line),  and  the  upper  asymptote  u„  (gray  dashed  eurve).  Sinee 
«22  >  0,  the  upper  asymptote  u„  inereases  exponentially  aeross 
days.  Thus,  within  waking  episodes,  performanee  p,,  is 
inereasingly  drawn  upwards.  On  the  other  hand,  the  fixed 
point  p  is  loeated  above  the  initial  performanee  value  po(to)- 
Thus,  divergenee  from  the  fixed  point  would  entail  a  drive 
downwards.  Here,  the  net  result  is  that  performanee  impairment  is  predieted  to  inerease  aeross  days,  but  in  a 
deeelerating  manner  (ef  Van  Dongen  et  al.,  2003).  If  wakefulness  were  maintained  for  additional  days,  though,  the 
performanee  predietions  would  eross  the  fixed  point  and  then  diverge  from  it  upwards,  exposing  the  typieal 
esealating  behavior  for  If  >  If;  in  this  model  (see  the  illustration  in  Fig.  9). 


Days 


Figure  11:  Experimental  observations  and  predietions  by  our  new 
model  for  performanee  impairment.  A  total  of  66  healthy  young 
adults  were  subjeeted  to  one  of  four  laboratory  sleep  deprivation 
protoeols  (Belenky  et  al.,  2003).  Eaeh  protoeol  began  with  several 
baseline  days  involving  8h  time  in  bed  (TIB),  the  last  of  whieh  is 
labeled  here  as  day  0.  Subsequently,  the  subjeets  underwent 
various  doses  of  sleep  restrietion  for  7  eonseeutive  days,  followed 
by  3  days  with  reeovery  sleep  at  8h  TIB.  The  sleep  restrietion 
doses  were  3h  TIB  per  day  for  13  subjeets  (blue);  5h  TIB  per  day 
for  13  subjeets  (brown);  7h  TIB  per  day  for  14  subjeets  (orange); 
and  9h  TIB  per  day  for  16  subjeets  (purple).  Awakening  was 
seheduled  at  07 :00  eaeh  day.  Cognitive  performanee  was  tested 
every  day  at  09:00,  12:00,  15:00  and  21:00  using  the  PVT.  In  the 
5h  TIB  eondition  an  additional  test  bout  oeeurred  at  midnight,  and 
in  the  3h  TIB  eondition  another  one  took  plaee  two  hours  after 
midnight. 

(a)  Observed  performanee  (PVT  lapses)  for  eaeh  test  bout  (dots 
represent  group  averages).  The  first  test  bout  of  eaeh  waking 
period  is  omitted  in  order  to  avoid  eonfounds  from  sleep  inertia. 
Gray  bars  indieate  seheduled  sleep  periods. 

(b)  Corresponding  performanee  predietions  aeeording  to  the  new 
model  defined  by  Eqs.  (40)  and  (45).  Parameter  estimates  are  fixed 
at  the  values  of  Eqs.  (46),  as  previously  estimated  with  the  data  in 
Fig.  8a.  Boxes  represent  predietions  at  wake  onset;  thin  eurves 
represent  predietions  within  days.  The  foeus  here  is  on  ehanges 
aeross  days  (dashed  lines).  Note  that  the  model  predietions  aeross 
the  7  days  of  sleep  restrietion  aeeurately  eapture  the  qualitative 
ehange  from  eonvergenee  (i.e.,  leveling  off  of  performanee 
impaimient)  in  the  9h,  7h  and  5h  TIB  eonditions,  to  divergenee 
(disproportionately  rapid  esealation  of  performanee  impairment) 
in  the  3h  TIB  eondition. 
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Applying  linear  scaling  to  account  for  any  irrelevant  differences  in  absolute  performance 
outcomes  (e.g.,  due  to  variations  in  population  characteristics  or  performance  testing  conditions), 
we  find  the  scaling  factor  to  be  1.17 — suitably  close  to  1.  The  corresponding  performance 
predictions  are  shown  in  Fig.  1  lb.  They  explain  72.2%  of  the  variance  in  the  data,  and  fit  well  to 
the  observed  performance  changes  across  days. 

Note  that  the  fV=  21h  condition  shows  a  divergent  profile  in  both  observations  and  predictions 
(Figs.  11a  and  1  lb),  which  is  not  seen  in  the  JV<  19h  conditions  in  this  study.  This  qualitative 
difference  indicates  the  presence  of  a  bifurcation.  Indeed,  on  the  basis  of  fitting  the  model  to  the 
data  in  Fig.  8a,  we  had  predicted  that  a  bifurcation  should  occur  at  JVc  =  20. 2h  (see  above).  The 
goodness-of-fit  of  our  model  to  the  data  in  Fig.  1  la  is  consistent  with  this  prediction,  and 
provides  a  first  validation  of  the  model. 


New  Theoretical  Predictions 

The  value  of  a  new  model  is  determined,  in  part,  by  any  falsifiable  new  predictions  it  makes. 

Here  we  present  two  specific  predictions  that  can  be  tested  in  future  work,  and  that  will  have 
considerable  theoretical  impact  if  confirmed.  The  first  new  prediction  pits  the  new  model  defined 
by  Eqs.  (40)  against  the  only  other  quantitative,  sleep/wake  physiology-based  model  of  the 
effects  of  chronic  sleep  restriction  on  cognitive  performance;  the  excess  wakefulness  model 
(Van  Dongen  et  al.,  2003).  In  that  model,  performance  impairment  across  days  is  posited  to  be 
proportional  to  the  cumulative  amount  of  wakefulness  exceeding  a  maximum  period  of  stable 
wakefulness  (of  ~16h  if  prior  sleep  duration  exceeds  -'4h).  This  is  conceptually  distinct  from  the 
modeling  framework  introduced  in  the  present  report. 

Our  first  prediction  involves  the  important  question  of  how  much  sleep  is  needed  to  recover  from 
performance  impairment  induced  by  prior  chronic  sleep  restriction  (e.g.,  Lamond  et  al.,  2007). 
The  excess  wakefulness  model  would  predict  that  as  long  as  wake  duration  exceeds  the 
maximum  period  of  stable  wakefulness,  performance  continues  to  deteriorate.  On  the  contrary, 
the  model  defined  by  Eqs.  (40)  with  the  parameter  values  given  by  Eqs.  (46)  would  predict  that 
when  wake  duration  is  less  than  the  bifurcation  point  JVc,  performance  levels  should  converge  to 
a  fixed  point,  and  thus  some  recovery  could  occur  if  wake  duration  is  shorter  than  what  was 
maintained  in  the  prior  days  of  chronic  sleep  loss. 

As  a  specific  example,  consider  a  scenario  involving  5  days  of  sleep  restriction  to  4h  per  day 
(i.e.,  JV=  20h),  followed  by  a  day  with  6h  time  for  sleep  (i.e.,  fV=  18h).  The  opposing  model 
predictions  are  illustrated  in  Eig.  12.  The  excess  wakefulness  model  predicts  that  performance 
deteriorates  progressively  across  the  5  days  with  4h  sleep,  and  continues  to  deteriorate — albeit  at 
a  slower  rate — following  the  6h  sleep.  Our  new  model  also  predicts  progressive  performance 
degradation  across  the  5  days  with  4h  sleep.  However,  the  fixed  point  for  6h  sleep  (IF=  18h)  is 
lower  than  the  level  of  performance  degradation  reached  after  5  days  with  4h  sleep.  Therefore, 
the  new  model  forecasts  some  degree  of  recovery  after  the  subsequent  6h  sleep.  This  prediction 
may  seem  counterintuitive  considering  that  6h  sleep  following  multiple  days  with  8h  sleep 
actually  leads  to  performance  degradation  (Van  Dongen  et  al.,  2003).  Yet,  preliminary  evidence 
from  an  ongoing  laboratory  study  (Banks  et  al.,  2005)  suggests  that  some  recovery  does  occur 
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scenario,  supporting  the  new  model  over  the  exeess 


with  6h  sleep  in  this  ehronic  sleep  restrietion 
wakefulness  model. 


(a)  (b) 


Days  Days 


Figure  12:  Opposing  predietions  from  two  models 
regarding  reeovery  following  ehronie  sleep  restrietion.  The 
figure  shows  performanee  predietions  at  wake  onset 
(boxes)  for  five  24h  days  with  sleep  restrietion  to  4h  per 
day  (IF=  20h)  followed  by  one  24h  day  with  6h  reeovery 
sleep  (IF=  18h).  Gray  areas  indieate  noetumal  sleep 
periods,  (a)  Predietions  for  performanee  ehanges  aeross 
days  aeeording  to  the  exeess  wakefulness  model  (Van 
Dongen  et  al.,  2003).  This  model  prediets  that  performanee 
deteriorates  progressively  aeross  the  5  days  with  4h  sleep, 
and  eontinues  to  deteriorate  at  a  slower  rate  following  the 
6h  sleep  period,  (b)  Predietions  for  performanee  ehanges 
aeross  days  aeeording  to  the  model  given  by  Eqs.  (40),  (45) 
and  (46).  This  new  model  also  prediets  that  performanee 
deteriorates  progressively  aeross  the  5  days  with  4h  sleep, 
but  foreeasts  a  modest  relative  performanee  improvement 
following  the  6h  reeovery  sleep. 


The  second  new  prediction  concerns  the  “reeyele”  issue,  which  derives  from  the  question  of 
whether  or  not  there  is  any  carry-over  of  performance  impairment  from  past  sleep  restrietion 
when  beginning  a  new  period  of  sleep  restriction  following  limited  time  for  recovery.  We 
eonsider  a  laboratory  study  currently  underway  (Banks  et  al.,  2007b),  whieh  involves  a  period  of 
5  days  with  sleep  restrietion  to  4h  per  day  (i.e.,  W=  20h),  followed  by  a  day  with  lOh  time  for 
recovery  sleep  (i.e.,  W=  14h),  followed  by  another  period  of  5  days  with  sleep  restriction  to  4h 
per  day  (W=  20h).  Initial  experimental  evidence  would  suggest  that  the  intervening  lOh  sleep 
period  should  be  enough  for  (near-)oomplete  recovery  to  baseline  performance  (Banks  et  ah, 
2007a),  effectively  undoing  the  impairment  ineurred  by  the  prior  sleep  loss.  Thus,  the 
performance  profde  seen  during  the  second  5-day  period  of  sleep  restrietion  might  be  expected  to 
be  similar  to  that  seen  during  the  first  5-day  period  of  sleep  restriction. 


Figure  13:  New  prediction  for  rapid  recycling  after  a 
period  of  chronic  sleep  restriction.  The  figure  shows 
predicted  performance  at  wake  onset  (boxes)  over 
days,  during  a  period  of  five  24h  days  with  sleep 
restriction  to  4h  per  day  (IF=  20h),  followed  by  one 
24h  day  with  lOh  recovery  sleep  (IF=  14h),  followed 
by  recycling  into  a  second  period  of  five  24h  days  with 
sleep  restriction  to  4h  per  day  (IF=  20h).  Gray  areas 
indicate  nocturnal  sleep  periods.  The  performance 
predictions,  derived  from  the  new  model  given  by  Eqs. 
(40),  (45)  and  (46),  indicate  that  the  intermittent 
recovery  sleep  should  confer  only  a  short-lasting 
benefit — in  the  second  period  of  sleep  restriction, 
performance  is  predicted  to  further  deteriorate  (while 
converging  towards  the  asymptotically  stable  fixed 
point  for  20h  with  a  time  constant  extending  far 
beyond  the  period  displayed  in  the  graph). 
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The  dynamics  of  the  new  model,  however,  would  imply  that  the  single  lOh  recovery  sleep  should 
be  seen  as  an  intermittent  perturbation  in  an  extended  series  of  days  with  sleep  restriction  to  4h 
per  day.  Thus,  the  model  predicts  that  the  recovery  sleep  confers  only  a  short-lasting 
performance  improvement,  after  which  performance  further  deteriorates  as  it  continues  to 
converge  to  the  asymptotically  stable  fixed  point  associated  with  W  =  20h.  This  prediction  is 
illustrated  in  Fig.  13.  Preliminary  evidence  from  the  laboratory  study  examining  the  scenario  at 
hand  suggests  that  indeed  there  is  substantial  carry-over  of  performance  impairment  from  the 
first  5-day  sleep  restriction  period  to  the  second  (Banks  et  ah,  2007b),  providing  tentative 
support  for  the  new  model. 


Discussion 

The  regulation  of  sleep,  wakefulness  and  performance  is  not  fully  understood,  and  involves  an 
array  of  possible  neurobio  logical  mechanisms  (e.g.,  Porkka-Heiskanen  et  ah,  1997;  Krueger  and 
Obal,  2003;  Fuller  et  ah,  2006).  Nonetheless,  at  the  behavioral  level,  the  circadian  component 
has  been  captured  by  models  with  relatively  few  degrees  of  freedom  (see  Indie  et  ah,  2006).  We 
believe  the  same  may  be  possible  for  the  sleep  homeostatic  component.  Using  evidence  from 
laboratory  studies  with  multiple  days  of  sleep  loss  (Figs.  8a  and  11a),  we  showed  that  the 
homeostatic  regulation  of  cognitive  performance  can  be  described  by  means  of  a  system  of 
coupled  non-homogeneous  first-order  ODEs  with  only  a  few  additional  degrees  of  freedom 
relative  to  the  homeostatic  process  postulated  in  the  original  two-process  model  (Borbely  and 
Achermann,  1994,  1999). 

Our  new  model  does  include  an  additional  component,  modulating  the  homeostatic  process 
across  days  and  weeks,  as  prompted  by  findings  from  chronic  sleep  restriction  experiments 
demonstrated  to  be  incongruent  with  the  original  two-process  model  (Van  Dongen  et  ah,  2003; 
Van  Dongen,  2004).  Yet,  the  model  structure  introduced  here  is  essentially  still  composed  of  a 
homeostatic  process  and  a  circadian  process.  Conceptually,  therefore,  the  new  model  remains 
compatible  with  the  principles  of  sleep  regulation  instantiated  in  the  original  two-process  model 
(Borbely,  1982).  The  dynamics  of  the  new  model  across  days  are  principally  governed  by  the  a 
and  a  coefficient  matrices  in  the  homogeneous  part  of  the  differential  equations  (the  homeostatic 
process),  while  the  changes  within  days  are  primarily  governed  by  the  non-homogeneities  (the 
circadian  process).  These  model  components  also  interact,  in  agreement  with  laboratory 
observations  of  a  nonlinear  interaction  between  the  homeostatic  and  circadian  processes  (Dijk  et 
ah,  1992;  Van  Dongen  and  Dinges,  2003a). 

Two  seminal  laboratory  studies  first  highlighted  the  need  for  fundamentally  new  model 
development  beyond  the  two-process  model  in  order  to  account  for  the  waking  cognitive 
consequences  of  chronic  sleep  loss  (Belenky  et  ah,  2003;  Van  Dongen  et  ah,  2003).  However, 
these  two  studies  previously  drew  markedly  different  conclusions  about  the  dynamics  of 
cognitive  impairment  across  days  of  sleep  restriction.  In  their  study  with  7  days  of  systematic 
sleep  restriction,  Belenky  et  al.  (2003)  reported  a  plateau  of  cognitive  impairment  when  sleep 
was  restricted  to  7h  or  5h  per  day,  as  well  as  incomplete  recuperation  at  the  end  of  the  study  after 
3  days  with  8h  time  in  bed  for  recovery  sleep.  They  hypothesized  that  chronic  sleep  loss  induces 
long-lasting  adaptive  changes  in  the  brain’s  response  to  sleep  loss,  leading  to  stabilized  reduced 
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performance  under  conditions  of  sleep  loss  at  the  cost  of  transiently  diminished  maximal 
performance  capacity  following  recovery  sleep.  In  contrast,  in  their  study  with  14  days  of  sleep 
restriction,  Van  Dongen  et  al.  (2003)  noted  that  performance  continued  to  degrade  when  sleep 
was  restricted  to  6h  or  4h  per  day,  with  no  evidence  of  adaptation  across  the  study  period. 

In  the  present  project,  the  two  data  sets  (Figs.  8a  and  I  la)  were  examined  in  a  single  analytical 
framework.  Using  PVT  performance  lapses  as  a  well-validated  outcome  measure  (Dorrian  et  ah, 
2005)  for  both  studies,  no  convincing  evidence  of  an  impairment  plateau  is  found  in  either  data 
set.  Yet,  our  modeling  results  indicate  that  stabilization  of  performance  impairment  would  occur 
eventually,  beyond  the  duration  of  the  two  experiments.  Furthermore,  the  modeling  outcomes 
suggest  that  several  days  with  recovery  sleep  would  be  needed  to  restore  performance  to  baseline 
levels.  Experiments  currently  underway  (Banks  et  ah,  2007a,  2007b)  will  shed  further  light  on 
the  time  course  of  post-deprivation  recovery. 

Our  mathematical  examination  of  the  dynamics  of  the  new  model  defined  by  Eqs.  (40)  revealed 
an  unanticipated  emergent  model  property:  a  bifurcation  involving  a  critical  amount  of 
wakefulness  which,  if  exceeded,  changes  the  model  behavior  from  a  state  of  convergence  toward 
an  asymptotically  stable  fixed  point,  to  a  state  of  divergence  away  from  an  unstable  fixed  point 
(as  illustrated  in  Eig.  9).  This  feature,  previously  alluded  to  (Belenky  et  ah,  2003;  Van  Dongen 
and  Dinges,  2003b)  but  as  yet  never  explicitly  considered,  turned  out  to  capture  an  essential 
aspect  of  the  nature  of  performance  impairment  due  to  sleep  loss.  Using  data  from  the  chronic 
sleep  restriction  and  total  sleep  deprivation  experiments  documented  by  Van  Dongen  et  al. 

(2003)  (Eig.  8a),  we  estimated  the  critical  wakefulness  threshold  to  occur  at  20. 2h,  that  is,  at  3.8h 
sleep  per  24h.  This  estimate  was  supported  by  data  from  the  chronic  sleep  restriction  study  of 
Belenky  et  al.  (2003),  who  observed  escalating  performance  impairment  when  sleep  was  reduced 
to  just  3h  per  day  (Eig.  11a). 

The  importance  of  the  bifurcation  in  the  new  model  implies  that  other  two-process-based  models 
of  performance  impairment  due  to  chronic  sleep  loss  (Hursh  et  ah,  2004;  Johnson  et  ah,  2004; 
Avinash  et  al.,  2005),  which  do  not  possess  the  bifurcation  property,  must  have  a  more  limited 
range  of  applicability  than  the  new  model.  The  excess  wakefulness  model  (Van  Dongen  et  ah, 
2003),  which  is  based  on  the  fundamentally  different  conjecture  that  performance  impairment 
across  days  is  proportional  to  the  cumulative  amount  of  wakefulness  in  excess  of  a  ration 
determined  by  the  preceding  sleep  period,  does  not  a  priori  have  this  same  limitation  of  scope 
(Van  Dongen  and  Dinges,  2003b).  However,  the  excess  wakefulness  model  and  the  model 
introduced  in  the  present  report  make  opposite  predictions  for  performance  impairment  after  a 
period  of  chronic  sleep  restriction  followed  by  a  limited  amount  of  recovery  sleep  (Eig.  12).  This 
juxtaposition  entails  the  first  of  two  testable  new  predictions  by  which  our  present  model  can  be 
validated. 

The  other  new  prediction,  which  has  real-life  relevance,  concerns  the  longevity  of  the 
performance  improvement  conferred  by  a  single  prolonged  recovery  night  (“sleeping  in”) 
preceded  and  followed  by  periods  of  chronic  sleep  restriction  (Eig.  13).  Our  model  predicts  that  a 
single  recovery  night  intervening  a  series  of  consecutive  sleep  opportunities  of,  say,  4h  per  day 
constitutes  a  mere  temporary  perturbation,  after  which  performance  levels  continue  to  decline 
and  converge  to  an  asymptotically  stable  fixed  point.  Confirmation  of  this  prediction  by 
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experimental  evidenee  eurrently  being  obtained  (Banks  et  al.,  2007b)  will  have  signifieant 
implieations — ^both  theoretieally,  for  our  understanding  of  sleep  and  performanee  regulation,  and 
praotieally,  with  regard  to  sleep/wake/work  seheduling  in  operational  settings. 

The  dynamies  of  the  model  defined  by  Eqs.  (40)  may  provide  insight  into  the  nature  of  the 
underlying  neurobiologieal  meehanisms.  Coneeptually,  the  model  resembles  a  system  of  two 
eonneeted  eompartments  eontaining  interaeting  substanees  with  time -varying  eoneentrations — 
one  with  longer  time  eonstants  than  the  other.  In  this  regard,  our  model  eould  be  a  mathematieal 
representation  of  the  interaetion  between  a  neurotransmitter  or  neuromodulator  and  its  reeeptor, 
with  the  density  of  both  ehanging  dynamieally  aeross  time  awake  and  time  asleep.  However,  the 
model’s  dynamie  behavior  and  the  parameter  estimates  we  obtained  (notably  the  finding  that 
ai2  >  0  and  an  >  0)  point  to  positive  feedbaek  regulation  in  the  system,  whieh  is  not  typieal  in 
neurotransmitter/neuromodulator  meehanisms.  Yet,  sueh  a  regulatory  proeess  may  be  taking 
plaee  in  the  adenosinergie  system. 

Adenosine  is  a  (by)produet  of  brain  energy  metabolism  (Porkka-Heiskanen  et  ah,  2002),  and  has 
been  reported  to  induee  sleepiness  and  impair  waking  funetions,  partieularly  through  the 
eholinergie  system  in  the  basal  forebrain  (Basheer  et  al.,  2000).  Henee,  the  adenosinergie  system 
might  be  a  final  pathway  in  the  homeostatie  regulation  of  sleep  and  waking  eognitive  funetions 
(Benington  and  Heller,  1995),  and  eould  be  the  temporal  bottleneek  that  determines  the  time 
eonstants  aeross  days  in  our  model.  In  aeeordanee  with  the  dynamie  strueture  of  the  model,  it  has 
been  observed  that  both  extraeellular  adenosine  level  and  adenosine  Ai  reeeptor  density  ehange 
dynamieally  in  response  to  sleep  loss  (Yanik  and  Radulovaeki,  1987;  Basheer  et  ah,  2004,  2007; 
Elmenhorst  et  al.,  2007;  Porkka-Heiskanen  et  ah,  2000).  Moreover,  sleep  deprivation-indueed 
inereases  in  extraeellular  adenosine  lead  to  eoneomitant  inereases  in  Ai  reeeptor  expression, 
implieating  positive  feedbaek  regulation  (Basheer  et  ah,  2007)  in  agreement  with  the  model. 

Based  on  these  eonsiderations,  we  propose  an  explanation  for  the  effeets  of  sleep  loss  on  PVT 
performanee  lapses  in  partieular,  and  on  eognitive  performanee  in  general,  in  terms  of  adenosine 
binding  to  reeeptors  that  are  up-  and  downregulated  dynamieally  aeross  wake/sleep  eyeles.  We 
postulate  that  periods  of  wakefulness  and  sleep  induee  adenosine  reeeptor  upregulation  and 
downregulation,  respeetively,  as  represented  in  the  model  by  inereases  and  deereases  of  the 
asymptotes  u  and  v.  Thus,  inereased  adenosine  produetion  during  extended  wakefulness  would 
eause  both  inereased  sleep  homeostatie  pressure  indueing  waking  eognitive  impairment,  and 
reeeptor  upregulation.  This  would  effeetively  enhanee  sensitivity  to  sleep  loss  on  subsequent 
days  (Basheer  et  ah,  2007),  whieh  would  serve  a  proteetive  funetion  by  restraining  further  sleep 
restrietion.  Should  additional  sleep  loss  oeeur  anyway,  a  shifted  physiologie  balanee  would 
establish  as  the  rates  of  adenosine  reeeptor  upregulation  during  wakefulness  and  downregulation 
during  sleep  reaeh  a  new  equilibrium. 

However,  if  wakefulness  is  extended  to  more  than  the  eritieal  amount  JVc,  whieh  we  have 
estimated  to  be  20. 2h,  then  a  physiologie  balanee  may  no  longer  be  aehievable.  This  bifureation, 
observed  in  both  the  model  predietions  and  the  experimental  observations,  may  suggest  a  role  for 
slow  wave  aetivity  (SWA;  -'0.5-4. 5  Hz)  in  the  EEG  of  non-REM  sleep.  SWA  is  substantially 
preserved  when  sleep  duration  is  redueed  down  to  4h  per  day  (Brunner  et  ah,  1993;  Van  Dongen 
et  ah,  2003).  However,  when  daily  sleep  is  restrieted  below  approximately  4h,  then  insuffieient 
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time  remains  to  fully  express  SWA  (see  Van  Dongen  and  Dinges,  2003b).  This  reduetion  in 
SWA  could  be  related  to  the  qualitative  change  in  the  effects  of  sleep  loss  on  cognitive 
performance  when  sleep  duration  is  reduced  to  below  ~4h  per  day. 

Also,  a  connection  between  SWA  and  adenosinergic  mechanisms  has  been  noted.  For  instance, 
stimulation  of  adenosine  Ai  receptors  affects  SWA  expression  in  the  same  manner  as  does  acute 
total  sleep  deprivation  (e.g.,  Benington  et  ah,  1995). 

Here,  we  hypothesize  more  specifically  that  SWA  is  a  physiological  correlate  of  adenosine 
receptor  downregulation  during  sleep.  This  could  explain  why  homeostatic  balance  can  be 
achieved  when  wake  duration  is  no  more  than  approximately  20h  per  24h  day,  as  it  allows 
enough  time  for  sleep  (at  least  ~4h)  to  preserve  SWA.  However,  if  daily  wakefulness  is  extended 
beyond  the  bifurcation  threshold,  then  despite  SWA  intensification,  the  overall  expression  of 
SWA  is  curtailed.  The  hypothesized  adenosine  receptor  downregulation  may  thus  no  longer  be 
sufficient  to  counter  the  upregulation  during  prior  wakefulness,  and  a  homeostatic  balance  may 
not  be  reached  anymore.  As  a  result,  adenosinergic  sensitivity  to  sleep  loss  would  escalate, 
which  in  turn  would  cause  the  accelerating  cognitive  impairment  that  has  been  observed  under 
such  extreme  sleep  restriction  conditions  (Belenky  et  ah,  2003;  Van  Dongen  et  ah,  2003;  Van 
Dongen  and  Dinges,  2003b). 

Our  proposed  account  of  the  waking  cognitive  effects  of  sleep  deprivation  across  days, 
postulated  to  be  governed  by  dynamic  changes  in  both  adenosine  production  and  adenosine 
receptor  expression,  may  have  noteworthy  implications  for  the  role  of  caffeine  as  a 
countermeasure  for  cognitive  impairment  due  to  sleep  loss.  Caffeine’s  main  mode  of  action  is  as 
an  adenosine  receptor  antagonist  (e.g.,  Biaggioni  et  ah,  1991).  As  such,  in  addition  to  mitigating 
the  cognitive  consequences  of  sleep  loss  (e.g.,  Penetar  et  ah,  1993),  it  might  also  block  the  sleep 
deprivation-mediated  adenosine  receptor  upregulation. 

It  may  thus  be  hypothesized  that  regular  consumption  of  moderate  amounts  of  caffeine  could 
help  to  prevent  increasing  sensitivity  to  sleep  loss  across  days  of  sleep  restriction,  which  would 
offer  a  strategy  for  managing  chronic  sleep  loss.  Although  this  may  already  be  practiced  by 
millions  of  individuals  around  the  world,  how  this  could  be  effective  had  not  really  been 
understood  mechanistically  as  yet  (and  still  needs  to  be  confirmed  by  experimental  evidence). 

At  higher  doses,  caffeine  may  interfere  with  the  expression  of  SWA  (e.g.,  LaJambe  et  ah,  2005), 
which  by  extension  of  our  hypothesis  would  block  the  sleep-related  downregulation  of  adenosine 
receptors.  Thus,  depending  on  dose,  caffeine  may  also  be  counterproductive  in  mitigating  the 
waking  cognitive  consequences  of  sleep  loss.  In  that  sense,  effective  use  of  caffeine  as  a 
countermeasure  for  sleep  loss  may  not  be  straightforward.  In  safety-critical  scenarios,  therefore, 
it  may  be  advisable  to  target  caffeine  administration  with  the  help  of  a  biology-based  model  of  its 
physiological  effects.  Such  a  model  could  be  developed  using  the  new  mathematical  framework 
introduced  in  the  present  report. 

In  conclusion,  we  have  put  forth  a  new  model  formulated  in  terms  of  coupled  non-homogeneous 
first-order  ODEs,  with  a  dynamic  repertoire  capturing  sleep  homeostatic  changes  in  waking 
cognitive  functions  across  a  wide  range  of  wake/sleep  schedules.  Further  work  is  needed  to 
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integrate  our  model  with  a  state-of-the-art  mathematieal  model  of  the  eireadian  eomponent  (e.g., 
Jewett  et  ah,  1999;  St.  Hilaire,  2007),  and  to  deal  with  sleep  inertia  (e.g.,  Akerstedt  and  Folkard, 
1997;  Jewett  and  Kronauer,  1999).  In  addition,  trait-like  inter-individual  differenees  in 
vulnerability  to  sleep  loss  (Van  Dongen  et  ah,  2004a)  have  yet  to  be  aeeounted  for  in  our  new 
model.  This  will  be  resolved  in  a  follow-up  projeet  using  modem  statistieal  modeling  tools  (e.g.. 
Van  Dongen  et  ah,  2004b,  2004e),  whieh  ean  also  yield  improved  model  parameter  estimates 
(and  their  standard  errors)  as  well  as  eonfidenee  intervals  for  the  model  predietions  (see 
Van  Dongen  et  ah,  2007a). 

Finally,  it  should  be  reeognized  that  the  effeets  of  sleep  loss  on  waking  eognitive  performanee 
depend  in  part  on  whieh  aspeets  of  eognitive  funetioning  are  eonsidered  (Durmer  and  Dinges, 
2005).  Our  present  foeus  on  PVT  performanee  lapses  entails  a  well-validated  (Dorrian  et  ah, 
2005)  but  ineomplete  aeeount  of  eognitive  responses  to  sleep  loss  (e.g.,  see  Van  Dongen  et  ah, 
2004a).  Ongoing  efforts  to  eonneet  fatigue  and  performanee  models  with  eomputational  models 
of  eognition  (Gunzelmann  et  ah,  2007)  represent  a  promising  strategy  to  address  this  issue. 
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THESIS  RESULTING  FROM  THE  PROJECT 

Deepa  Avinash,  M.S.  successfully  defended  her  Master’s  thesis  on  a  portion  of  the  work 
performed  for  this  project,  on  23  August  2005,  at  Drexel  University  in  Philadelphia, 
Pennsylvania.  The  executive  summary  of  her  thesis  (Avinash,  2005)  is  as  follows.  Results  are 
integrated  in  this  final  report. 

Laboratory  experiments  have  demonstrated  that  eognitive  performanee  deteriorates  due  to  sleep 
deprivation  and  sleep  restrietion  (even  if  sleep  is  redueed  only  a  few  hours  per  day  on  a  ehronie 
basis).  Various  biomathematieal  models  have  been  developed  to  prediet  performanee  defieits 
resulting  from  sleep  deprivation.  One  influential  model  is  the  “two-proeess  model”  of  sleep 
regulation,  whieh  prediets  sleep  and  performanee  on  the  basis  of  two  interaeting  proeesses.  The 
first  proeess,  referred  to  as  the  “sleep  homeostaf  ’  or  Proeess  S,  whieh  seeks  to  balanee  time  spent 
awake  and  time  spent  asleep.  The  seeond  proeess,  known  as  the  “eireadian  rhythm”  or  Proeess  C, 
is  driven  by  the  biologieal  eloek  in  the  brain,  whieh  keeps  traek  of  the  time  of  day.  The  two- 
proeess  model  properly  prediets  the  performanee  degradation  assoeiated  with  multiple  days  of 
total  sleep  deprivation,  but  does  not  aeeurately  prediet  performanee  under  eonditions  of  ehronie 
partial  sleep  restrietion.  The  model  prediets  that  ehronie  sleep  restrietion  leads  to  relatively  little 
eognitive  impairment,  whereas  laboratory  experiments  have  shown  that  performanee  deteriorates 
progressively  aeross  days  of  sleep  restrietion.  This  thesis  deseribes  the  development  of  an 
expansion  of  the  two-proeess  model  to  aeeurately  prediet  the  performanee  impairment  resulting 
from  ehronie  sleep  loss,  by  integrating  a  novel  Proeess  U  along  with  the  original  two  proeesses  S 
and  C.  The  parameters  of  Proeess  U  were  estimated  using  statistieal  analysis.  The  parameter 
assessment  was  performed  by  maximum  likelihood  estimation  using  nonlinear  mixed  effeets 
modeling  (NONMEM)  software.  The  predietions  of  the  expanded  two-proeess  model  were 
eompared  to  psyehomotor  vigilanee  task  (PVT)  performanee  data  from  a  laboratory  experiment 
involving  14  days  of  sleep  restrietion  to  4h,  6h  or  8h  time  in  bed  (TIB)  or  3  days  of  total  sleep 
deprivation.  Model  predietions  were  fitted  to  experimental  observations  of  PVT  lapses  (reaetion 
times  >  500ms),  as  measured  every  2h  during  seheduled  wakefulness  in  the  laboratory  study.  We 
used  the  observations  from  two  baseline  days  (8h  TIB  per  day)  and  all  experimental  sleep  loss 
days,  for  a  total  of  n  =  47  subjeets;  as  well  as  data  from  one  reeovery  day  (8h  TIB)  for  the  subset 
of  34  subjeets  exposed  to  ehronie  sleep  restrietion.  The  expanded  two-proeess  model  may  prove 
useful  in  operational  environments  faeed  with  sleep  loss,  sueh  as  hospitals,  emergeney  serviees, 
and  transportation.  The  model  eould  be  used  for  improved  seheduling  of  work  hours  for  people 
working  in  sueh  sleep-deprived  environments,  or  to  signal  the  need  to  employ  fatigue 
eountermeasures  to  maintain  optimal  performanee.  Thus  the  expanded  model  may  help  optimize 
safety  and  performanee. 
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decrements  in  knowledge  access  resulting  from  increased  fatigue.  In  D.  S.  McNamara,  J.  G. 
Trafton  (Eds.),  Proceedings  of  the  twenty-ninth  annual  meeting  of  the  Cognitive  Science 
Society.  Lawrence  Erlbaum  Associates,  Mahwah,  2007;  329-334. 

G.  Gunzelmann,  L.  R  Moore  Jr.,  K.  A.  Gluck,  H.  P.  A.  Van  Dongen,  D.  E.  Dinges.  Individual 
differences  in  sustained  vigilant  attention;  Insights  from  computational  cognitive  modeling.  In 
D.  S.  McNamara,  J.  G.  Trafton  (Eds.),  Proceedings  of  the  thirtieth  annual  meeting  of  the 
Cognitive  Science  Society.  Lawrence  Erlbaum  Associates,  Mahwah,  in  press. 

R.  E.  Kronauer,  G.  Gunzelmann,  H.  P.  A.  Van  Dongen,  E.  J.  Doyle  III,  E.  B.  Klerman. 

Uncovering  physiologic  mechanisms  of  circadian  rhythms  and  sleep/wake  regulation  through 
mathematical  modeling.  Journal  of  Biological  Rhythms  2007;  22;  233-245. 
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D.  J.  Mollicone,  H.  P.  A.  Van  Dongen,  N.  L.  Rogers,  D.  F.  Dinges.  Response  surface  mapping  of 
neurobehavioral  performance;  Testing  the  feasibility  of  split  sleep  schedules  for  space 
operations.  Acta  Astronautica,  in  press. 

H.  P.  A.  Van  Dongen,  J.  A.  Caldwell  Jr.,  J.  L.  Caldwell.  Investigating  systematic  individual 
differences  in  sleep-deprived  performance  on  a  high-fidelity  flight  simulator.  Behavior 
Research  Methods  2006;  38;  333-343. 

H.  P.  A.  Van  Dongen,  C.  G.  Mott,  J.-K.  Huang,  D.  J.  Mollicone,  F.  D.  McKenzie,  D.  F.  Dinges. 
Optimization  of  biomathematical  model  predictions  for  cognitive  performance  impairment  in 
individuals;  Accounting  for  unknown  traits  and  uncertain  states  in  homeostatic  and  circadian 
processes.  Sleep  2007;  30;  1129-1143. 

Peer-reviewed  conference  abstracts 

P.  McCauley,  A.  Smith,  G.  Belenky,  H.  Van  Dongen.  Adapting  to  sleep  loss;  Dynamic  properties 
of  cognitive  performance  predictions  based  on  the  two-process  model.  Sleep  2007;  30;  A123. 

A.  D.  Smith,  A.  C.  Genz,  G.  Belenky,  H.  Van  Dongen.  An  efficient  procedure  for  finding  the 
95%  confidence  interval  of  performance  predictions  based  on  the  Two-Process  Model.  Sleep, 
in  press. 

A.  Smith,  P.  McCauley,  G.  Belenky,  H.  Van  Dongen.  Efficient  computational  procedure  for 
individualization  of  sleep/wake  model  parameters.  Sleep  2007;  30;  A352. 

H.  P.  A.  Van  Dongen,  D.  Avinash,  B.  M.  Robinson,  D.  F.  Dinges,  M.  M.  Mallis.  Development  of 
an  Astronaut  Scheduling  Assistant.  Habitation  2006;  10;  210-211. 

H.  Van  Dongen,  C.  Mott,  J.  Huang,  D.  Mollicone,  F.  McKenzie,  D.  Dinges.  Biomathematical 
fatigue  modeling;  Individualized  prediction  of  cognitive  performance.  Sleep  2007;  30;  A149. 

H.  Van  Dongen,  C.  Mott,  J.-K.  Huang,  D.  J.  Mollicone,  F.  McKenzie,  D.  F.  Dinges. 

Individualized  biomathematical  modeling  of  cognitive  performance  impairment.  Sleep  and 
Biological  Rhythms  2007;  5;  A3  6. 

Miscellaneous 

D.  Avinash.  Modeling  performance  impairment  due  to  chronic  sleep  restriction.  Master’s  thesis. 
Drexel  University,  Philadelphia,  2005. 

D.  Avinash,  C.  P.  Crudele,  D.  D.  Amin,  B.  M.  Robinson,  D.  F.  Dinges,  H.  P.  A.  Van  Dongen. 
Parameter  estimation  for  a  biomathematical  model  of  psychomotor  vigilance  performance 
under  laboratory  conditions  of  chronic  sleep  restriction.  Sleep-Wake  Research  in  the 
Netherlands,  2005;  16;  39-42. 

H.  P.  A.  Van  Dongen,  C.  G.  Mott,  J.-K.  Huang,  D.  J.  Mollicone,  F.  D.  McKenzie,  D.  F.  Dinges. 
Confidence  intervals  for  individualized  performance  models.  Sleep  2007;  30;  1083. 


Interactions  and  Transitions 

Participation/presentations  at  meetings,  conferences,  seminars,  etc. 

March  2005  (Van  Dongen);  Lecture  “Investigating  the  neurobehavioral  consequences  of  sleep 
deprivation,”  Washington  State  University;  Pullman,  Washington. 

May  2005  (Van  Dongen);  Lecture  “Mathematical  models  of  neurobehavioral  performance 
changes  over  time;  Challenges  and  potential  for  use  in  scheduling  tools,”  Aerospace  Medical 
Association  76th  Annual  Scientific  Meeting;  Kansas  City,  Missouri. 
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June  2005  (Van  Dongen);  Lecture  “Modeling  human  cognitive  performance  with  the  two- 
process  model  and  beyond,”  American  Professional  Sleep  Societies  19th  Annual  Meeting; 
Denver,  Colorado. 

June  2005  (Van  Dongen);  Lecture  “Sleep  loss:  Individual  differences  and  effects  on  routine  life,” 
10th  Annual  Trainee  Symposium,  American  Professional  Sleep  Societies  19th  Annual 
Meeting;  Denver,  Colorado. 

September  2005  (Van  Dongen):  Keynote  lecture  “Sleep  loss  and  circadian  stressors  in  shiftwork: 
On  inter-individual  differences,”  17th  International  Symposium  on  Shiftwork  and  Working 
Time;  Hoofddorp,  The  Netherlands. 

September  2005  (Van  Dongen);  Lecture  “Theoretical  and  mathematical  predictions  of  the  two- 
process  model  relative  to  sleep  debt  and  excess  wakefulness,”  World  Federation  of  Sleep 
Research  and  Sleep  Medicine  Societies  Conference;  New  Delhi,  India. 

November  2005  (Van  Dongen);  Program  committee  member  for  the  “2005  Sleep  and  Circadian 
DataBlitz,”  Society  for  Neuroscience  Annual  Meeting;  Washington,  D.C. 

January  2006  (Van  Dongen):  Lecture  “Managing  sleep  to  sustain  performance,”  Washington 
State  University;  Spokane,  Washington. 

February  2006  (Van  Dongen);  Lecture  “Consequences  of  insufficient  sleep,”  in  the  Advanced 
Sleep  Medicine  Course;  La  Jolla,  California. 

April  2006  (Van  Dongen):  Lecture  “Inter-individual  differences  in  cognitive  impairment  from 
sleep  loss,”  Washington  State  University;  Pullman,  Washington. 

May  2006  (Belenky):  Lecture  “Managing  sleep  to  sustain  performance,”  Boeing  Flight 
Operations  Symposium  2006;  Seattle,  Washington. 

June  2006  (Van  Dongen);  Lecture  “Sleep,  sleep  deprivation,  cognitive  impairment  &  inter- 
individual  differences,”  in  the  Advances  in  Sleep  Medicine  Course;  Moving  the  Frontier 
Forward;  Salt  Lake  City,  Utah. 

June  2006  (Van  Dongen);  Lecture  “Measuring  cognitive  performance  during  sleep  deprivation — 
catching  the  brain  asleep,”  in  the  postgraduate  course  What  Is  It  That  Sleeps?  Salt  Lake  City, 
Utah. 

July  2006  (Van  Dongen):  Lecture  “Managing  sleep  to  sustain  performance,”  Airline  Pilots 
Association  Air  Safety  Forum;  Washington,  D.C. 

August  2006  (Van  Dongen);  Lecture  “Modeling  individual  differences,”  Joint  SIAM-SMB 
Conference  on  the  Life  Sciences;  Raleigh,  North  Carolina. 

September  2006  (Van  Dongen):  Organizer  of  the  symposium  “Inter-individual  differences  in 
sleep  and  sleep  regulation;  states  and  traits,”  Eighteenth  Congress  of  the  European  Sleep 
Research  Society;  Innsbruck,  Austria. 

September  2006  (Van  Dongen):  Eecture  “Trait  and  state  individual  differences  in  sleep 

structure,”  Eighteenth  Congress  of  the  European  Sleep  Research  Society;  Innsbruck,  Austria. 

September  2006  (Van  Dongen):  Eecture  “Individual  differences  in  sleep  and  sleep  deprivation,” 
Max  Planck  Institute  of  Psychiatry;  Munich,  Germany. 

October  2006  (Van  Dongen):  Co-organizers  of  the  workshop  “New  approaches  to  modeling 
sleep/wake  dynamics  and  cognitive  performance,”  Mathematical  Biosciences  Institute,  Ohio 
State  University;  Columbus,  Ohio. 

October  2006  (Van  Dongen);  Eecture  “Sleep  and  sleep  deprivation:  trait  inter-individual 
differences,”  University  of  Chicago;  Chicago,  Illinois. 

November  2006  (Van  Dongen);  Eecture  “Cognitive  impairment  from  sleep  loss:  individual 
differences  and  prediction,”  Washington  State  University;  Spokane,  Washington. 
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November  2006  (Van  Dongen):  Lecture  “Sleep,  sleep  deprivation,  and  cognitive  performance,” 
Idaho  Sleep  Disorders  Association  2006  Meeting;  Coeur  d’Alene,  Idaho. 

November  2006  (Van  Dongen,  Belenky):  Organization  of  the  international  symposium 
“Sleeping,  waking,  working,”  Sleep  and  Performance  Research  Center,  Washington  State 
University;  Spokane,  Washington. 

March  2007  (Smith):  Lecture  “Predicting  performance  impairment  under  conditions  of  sleep 
deprivation:  Individualization  and  confidence  intervals,”  Eastern  Washington  University; 
Cheney,  Washington. 

March  2007  (Van  Dongen):  Lecture  “Sleep  and  sleep  deprivation,”  Spokane  Chapter  of  the 
National  Rehabilitation  Association;  Spokane,  Washington. 

May  2007  (Van  Dongen,  Belenky):  Lecture  “Sleep  deprivation,”  Naval  Postgraduate  School; 
Monterey,  California. 

May  2007  (Van  Dongen):  Lecture  “Neurobiology  and  chronobiology  of  sleep,”  American 
Thoracic  Society  2007  Conference;  San  Francisco,  California. 

June  2007  (Van  Dongen):  Organization  of  the  symposium  “Individual  differences  in  sleep:  basic 
research  and  clinical  relevance,”  SLEEP  2007  Conference;  Minneapolis,  Minnesota. 

June  2007  (Van  Dongen):  Eecture  “Trait  individual  differences  in  the  sleep  structure  of  healthy 
young  adults,”  SEEEP  2007  Conference;  Minneapolis,  Minnesota. 

June  2007  (Van  Dongen):  Meet  the  Professor  session  “Cumulative  sleep  loss:  consequences  for 
wakefulness  and  sleep,”  SEEEP  2007  Conference;  Minneapolis,  Minnesota. 

July  2007  (Van  Dongen):  Briefing  on  “Sleep  deprivation,  cognitive  performance,  and 
biomathematical  modeling,”  JASON  2007  Summer  Study;  Ea  Jolla,  California. 

September  2007  (Van  Dongen):  Eecture  “Individual  differences  in  neurobehavioral  impairment 
from  sleep  loss,”  WorldSleep07;  Cairns,  Australia. 

September  2007  (Van  Dongen):  Eecture  :Status  and  perspectives  of  the  2-process  model: 
Neurobehavioral  functions,”  International  Symposium  on  25  Years  with  the  Two-Process 
Model  of  Sleep  Regulation;  Ittingen,  Switzerland. 

October  2007  (Van  Dongen):  Eecture  “Sleep  deprivation  and  circadian  rhythms,”  Washington 
State  Department  of  Services  for  the  Blind;  Tacoma,  Washington. 

November  2007  (Van  Dongen):  Eecture  “Fatigue  and  performance  models  in  24-hour 
operations:  Potential  and  challenges,”  National  Center  for  Intermodal  Transportation; 
Washington,  D.C. 

November  2007  (Van  Dongen):  Eecture  “Cognitive  performance  impairment:  Contribution  of 
homeostatic,  circadian,  and  individual  variability  factors,”  University  of  Surrey;  Guildford, 
United  Kingdom. 

February  2008  (Van  Dongen):  Eecture  “Bayesian  forecasting  for  predicting  individual 
performance:  Foundational  information,”  Individual  Differences  Workshop;  Baltimore, 
Maryland. 

Consultative  and  advisory  functions  to  other  laboratories  and  agencies 

January  2005-present  (Van  Dongen):  Member  of  steering  committee  for  Core  Capability  in 
Fatigue  and  Performance  Modeling  and  Interventions  Research,  Military  Operational 
Medicine  Research  Program,  Walter  Reed  Army  Institute  of  Research;  Washington,  D.C. 

March  2005-present  (Van  Dongen):  Member  of  Editorial  Advisory  Board,  Journal  of  Sleep 
Research. 
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April  2005-present  (Van  Dongen):  Consultation  for  NIH  K23  Career  Development  Award  of  Dr. 
Peter  Franzen,  Ph.D.,  University  of  Pittsburgh  Sehool  of  Medieine;  Pittsburgh,  Pennsylvania. 

June  2005-Mareh  2006  (Van  Dongen);  Consultation  on  individual  differenees  modeling  to  Dr. 
Adam  Fleteher,  Walter  Reed  Army  Institute  of  Researeh;  Washington,  D.C. 

July  2005  (Van  Dongen):  Aeademie  liaison  for  pharmaeologie  eountermeasures  panel  at  military 
operational  medieine  workshop  “Cognitive  performanee;  Foree  multiplieation  through 
human-in-the-loop  augmentation,”  U.S.  Army  Medieal  Researeh  and  Materiel  Command  & 
Defense  Advaneed  Researeh  Projeets  Ageney;  Las  Vegas,  Nevada. 

Oetober  2005  (Van  Dongen);  Member  of  National  Institutes  of  Health  program  projeet  grant 
review  panel;  Washington,  D.C. 

November  2005  (Belenky):  Consultation  on  fatigue  risk  management  to  Union  Paeifie  Railroad; 
Omaha,  Nebraska. 

January  2006  (Belenky):  Consultation  on  managing  sleep  to  sustain  performanee  to  U.S.  Air 
Foree  human  faetors  researehers;  Spokane,  Washington. 

June  2006-present  (Van  Dongen);  Assoeiate  Editor,  journal  SLEEP. 

September  2006  (Belenky):  Consultation  on  fatigue  risk  management  to  United  Airlines;  Denver, 
Colorado. 

September  2006-Mareh  2008  (Van  Dongen):  Member  of  dissertation  eommittee  for  Daniel 
Mollieone,  B.S.,  Drexel  University;  Philadelphia,  Pennsylvania. 

April  2007-present  (Van  Dongen);  Member  of  Editorial  Board,  The  Open  Sleep  Journal. 

Eebruary  2008-present  (Van  Dongen);  Member  of  advisory  group  for  Warfighter  Rapid 
Awareness  Proeessing  Teehnology  program,  Arehinoeties,  EEC;  Honolulu,  Hawaii. 

Transitions 

•  We  transitioned  the  Bayesian  foreeasting  framework  developed  as  part  of  this  projeet  to  help 
industry  develop  a  state/trait  optimization  tool  deployable  by  the  military  for  the  predietion  of 
eognitive  performanee  in  the  faee  of  both  unknown  individual  traits  and  uneertain  prior  states 
(key  individuals  involved:  Daniel  Mollieone,  Ph.D.  and  Christopher  Mott,  M.S.  of  Pulsar 
Informaties,  Ine.). 

•  We  transitioned  an  earlier  version  of  the  ehronie  modulating  proeess  developed  as  part  of  this 
projeet  to  the  Institute  of  Experimental  Psyehiatry  in  Philadelphia,  Pennsylvania,  so  as  to 
eontribute  to  the  development  of  an  Astronaut  Seheduling  Assistant  for  NASA  (key 
individuals  involved;  Melissa  Mallis,  Ph.D.  and  John  Caldwell,  Ph.D.  of  the  Eatigue 
Countermeasures  Group  at  NASA  Ames  Researeh  Center). 


New  Discoveries,  Inventions,  or  Patent  Disclosures 

A  provisional  patent  applieation  for  individualized  performanee  predietion  by  means  of  state/trait 
optimization  has  been  submitted.  This  applieation  eovers  a  range  of  individualization  algorithms 
developed  in  a  projeet  initiated  after  and  building  on  the  present  projeet,  and  funded  through 
other  meehanisms  (USAMRMC  awards  W81XWH-04- 1-0923  and  W81XWH-05-C-0155).  The 
provisional  patent  applieation  also  eovers  the  Bayesian  foreeasting  proeedure  outlined  in  this 
report,  as  applied  to  individualized  predietion  of  fatigue  and  performanee,  owing  to  the  faet  that 
the  other  individualization  algorithms  fundamentally  employ  the  same  mathematieal  and 
statistieal  prineiples. 
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